Jul 02 16:57:01.790852 ip-10-0-128-105 systemd[1]: Starting Kubernetes Kubelet... Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.149657 2535 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.155984 2535 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156004 2535 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156011 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156016 2535 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156021 2535 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156025 2535 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156029 2535 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:02.166821 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156033 2535 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156037 2535 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156041 2535 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156045 2535 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156049 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156053 2535 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156057 2535 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156061 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156065 2535 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156069 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156073 2535 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156077 2535 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156097 2535 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156101 2535 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156106 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156109 2535 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156113 2535 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156117 2535 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156121 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156125 2535 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:02.173853 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156128 2535 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156132 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156135 2535 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156140 2535 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156143 2535 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156147 2535 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156151 2535 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156157 2535 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156162 2535 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156167 2535 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156171 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156176 2535 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156181 2535 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156184 2535 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156188 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156192 2535 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156196 2535 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156200 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156203 2535 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156208 2535 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:02.174957 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156211 2535 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156215 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156219 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156222 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156226 2535 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156230 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156233 2535 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156237 2535 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156241 2535 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156245 2535 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156249 2535 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156253 2535 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156256 2535 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156260 2535 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156263 2535 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156268 2535 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156272 2535 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156276 2535 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156279 2535 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156283 2535 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:02.175817 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156287 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156291 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156294 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156298 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156303 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156307 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156311 2535 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156314 2535 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156318 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156321 2535 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156325 2535 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156329 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156333 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156337 2535 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156340 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156344 2535 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156348 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156351 2535 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156355 2535 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156359 2535 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:02.176693 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156364 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156369 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156372 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156376 2535 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156382 2535 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156387 2535 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156391 2535 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156396 2535 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156400 2535 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156404 2535 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156407 2535 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.156411 2535 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157408 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157417 2535 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157421 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157425 2535 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157429 2535 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157433 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157438 2535 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:02.177784 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157442 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157445 2535 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157449 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157453 2535 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157457 2535 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157461 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157465 2535 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157469 2535 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157472 2535 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157476 2535 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157480 2535 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157484 2535 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157488 2535 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157491 2535 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157496 2535 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157500 2535 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157504 2535 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157508 2535 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157512 2535 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157515 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:02.178870 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157519 2535 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157522 2535 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157526 2535 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157529 2535 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157550 2535 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157557 2535 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157562 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157566 2535 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157571 2535 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157574 2535 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157578 2535 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157583 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157589 2535 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157594 2535 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157598 2535 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157602 2535 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157608 2535 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157612 2535 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157615 2535 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:02.179744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157620 2535 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157623 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157627 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157630 2535 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157634 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157637 2535 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157641 2535 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157645 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157649 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157653 2535 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157657 2535 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157660 2535 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157664 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157667 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157672 2535 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157675 2535 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157679 2535 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157683 2535 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157686 2535 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157690 2535 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:02.180823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157694 2535 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157698 2535 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157702 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157708 2535 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157712 2535 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157717 2535 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157721 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157725 2535 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157729 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157733 2535 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157737 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157741 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157745 2535 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157749 2535 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157752 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157756 2535 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157759 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157763 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157766 2535 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:02.181719 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157770 2535 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157773 2535 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157777 2535 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157781 2535 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157784 2535 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157789 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157793 2535 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157797 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157800 2535 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157804 2535 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157808 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157812 2535 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157815 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.157820 2535 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158319 2535 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158326 2535 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158331 2535 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158334 2535 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158339 2535 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158343 2535 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:02.182792 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158346 2535 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158350 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158353 2535 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158360 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158364 2535 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158368 2535 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158372 2535 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158375 2535 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158379 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158383 2535 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158387 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158391 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158395 2535 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158399 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158403 2535 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158406 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158411 2535 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158414 2535 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158418 2535 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158422 2535 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:02.183869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158425 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158429 2535 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158434 2535 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158437 2535 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158441 2535 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158445 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158449 2535 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158453 2535 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158457 2535 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158460 2535 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158464 2535 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158469 2535 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158472 2535 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158476 2535 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158481 2535 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158486 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158490 2535 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158494 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158498 2535 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158502 2535 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:02.184744 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158506 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158509 2535 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158513 2535 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158517 2535 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158521 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158527 2535 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158531 2535 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158549 2535 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158554 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158557 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158561 2535 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158565 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158569 2535 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158573 2535 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158576 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158580 2535 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158586 2535 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158591 2535 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158596 2535 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158599 2535 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:02.185810 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158603 2535 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158607 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158611 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158615 2535 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158619 2535 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158623 2535 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158627 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158633 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158638 2535 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158642 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158646 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158649 2535 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158653 2535 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158657 2535 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158661 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158664 2535 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158668 2535 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158673 2535 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158677 2535 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158681 2535 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:02.186686 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158684 2535 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158688 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158692 2535 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158696 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158700 2535 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158703 2535 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158707 2535 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158711 2535 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158714 2535 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158719 2535 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158724 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158730 2535 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.158734 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158813 2535 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158821 2535 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158829 2535 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158835 2535 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158841 2535 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158846 2535 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158854 2535 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 16:57:02.187572 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158860 2535 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158865 2535 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158870 2535 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158875 2535 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158880 2535 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158884 2535 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158889 2535 flags.go:64] FLAG: --cgroup-root="" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158893 2535 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158898 2535 flags.go:64] FLAG: --client-ca-file="" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158904 2535 flags.go:64] FLAG: --cloud-provider="external" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158908 2535 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158915 2535 flags.go:64] FLAG: --cluster-domain="" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158919 2535 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158924 2535 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158930 2535 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158935 2535 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158941 2535 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158945 2535 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158950 2535 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158954 2535 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158959 2535 flags.go:64] FLAG: --contention-profiling="false" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158963 2535 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158967 2535 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158972 2535 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 16:57:02.188448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158976 2535 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158982 2535 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158986 2535 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158990 2535 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158994 2535 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.158999 2535 flags.go:64] FLAG: --enable-server="true" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159003 2535 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159011 2535 flags.go:64] FLAG: --event-burst="100" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159015 2535 flags.go:64] FLAG: --event-qps="50" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159020 2535 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159024 2535 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159029 2535 flags.go:64] FLAG: --eviction-hard="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159034 2535 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159038 2535 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159042 2535 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159047 2535 flags.go:64] FLAG: --eviction-soft="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159052 2535 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159057 2535 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159061 2535 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159065 2535 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159070 2535 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159074 2535 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159079 2535 flags.go:64] FLAG: --feature-gates="" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159084 2535 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159089 2535 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 16:57:02.189559 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159094 2535 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159099 2535 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159103 2535 flags.go:64] FLAG: --healthz-port="10248" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159107 2535 flags.go:64] FLAG: --help="false" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159112 2535 flags.go:64] FLAG: --hostname-override="ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159115 2535 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159120 2535 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159125 2535 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159130 2535 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159135 2535 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159139 2535 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159143 2535 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159148 2535 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159151 2535 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159168 2535 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159173 2535 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159177 2535 flags.go:64] FLAG: --kube-reserved="" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159182 2535 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159186 2535 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159191 2535 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159194 2535 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159199 2535 flags.go:64] FLAG: --lock-file="" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159203 2535 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159207 2535 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 16:57:02.190643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159213 2535 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159227 2535 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159232 2535 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159236 2535 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159240 2535 flags.go:64] FLAG: --logging-format="text" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159245 2535 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159249 2535 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159259 2535 flags.go:64] FLAG: --manifest-url="" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159264 2535 flags.go:64] FLAG: --manifest-url-header="" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159270 2535 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159275 2535 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159281 2535 flags.go:64] FLAG: --max-pods="110" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159285 2535 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159290 2535 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159295 2535 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159299 2535 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159304 2535 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159308 2535 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159313 2535 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159323 2535 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159327 2535 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159332 2535 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159338 2535 flags.go:64] FLAG: --pod-cidr="" Jul 02 16:57:02.191928 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159343 2535 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159351 2535 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159355 2535 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159360 2535 flags.go:64] FLAG: --pods-per-core="0" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159364 2535 flags.go:64] FLAG: --port="10250" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159369 2535 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159373 2535 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b159b976e3196a7" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159378 2535 flags.go:64] FLAG: --qos-reserved="" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159383 2535 flags.go:64] FLAG: --read-only-port="10255" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159387 2535 flags.go:64] FLAG: --register-node="true" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159393 2535 flags.go:64] FLAG: --register-with-taints="" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159404 2535 flags.go:64] FLAG: --registry-burst="10" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159409 2535 flags.go:64] FLAG: --registry-qps="5" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159412 2535 flags.go:64] FLAG: --reserved-cpus="" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159417 2535 flags.go:64] FLAG: --reserved-memory="" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159422 2535 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159427 2535 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159432 2535 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159436 2535 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159440 2535 flags.go:64] FLAG: --runonce="false" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159444 2535 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159449 2535 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159453 2535 flags.go:64] FLAG: --seccomp-default="false" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159458 2535 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159461 2535 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159466 2535 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 16:57:02.193032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159470 2535 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159474 2535 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159478 2535 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159483 2535 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159487 2535 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159494 2535 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159498 2535 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159504 2535 flags.go:64] FLAG: --system-cgroups="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159508 2535 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159516 2535 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159521 2535 flags.go:64] FLAG: --tls-cert-file="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159525 2535 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159532 2535 flags.go:64] FLAG: --tls-min-version="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159552 2535 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159557 2535 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159561 2535 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159568 2535 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159572 2535 flags.go:64] FLAG: --v="2" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159578 2535 flags.go:64] FLAG: --version="false" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159584 2535 flags.go:64] FLAG: --vmodule="" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159589 2535 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.159594 2535 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159754 2535 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159759 2535 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:02.292927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159763 2535 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:02.246248 ip-10-0-128-105 systemd[1]: Started Kubernetes Kubelet. Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159768 2535 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159772 2535 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159776 2535 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159780 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159783 2535 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159787 2535 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159791 2535 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159795 2535 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159799 2535 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159803 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159806 2535 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159810 2535 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159815 2535 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159819 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159823 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159827 2535 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159831 2535 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159834 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159838 2535 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:02.294494 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159842 2535 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159846 2535 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159850 2535 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159853 2535 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159859 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159863 2535 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159866 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159870 2535 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159875 2535 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159878 2535 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159882 2535 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159886 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159889 2535 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159893 2535 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159897 2535 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159900 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159904 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159907 2535 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159913 2535 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:02.301986 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159919 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159924 2535 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159927 2535 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159931 2535 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159935 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159939 2535 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159945 2535 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159948 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159952 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159957 2535 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159963 2535 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159968 2535 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159971 2535 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159976 2535 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159979 2535 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159983 2535 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159987 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159992 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.159996 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:02.303049 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160000 2535 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160004 2535 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160008 2535 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160012 2535 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160016 2535 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160020 2535 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160024 2535 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160028 2535 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160032 2535 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160036 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160040 2535 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160043 2535 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160047 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160051 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160056 2535 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160062 2535 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160065 2535 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160069 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160073 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:02.303921 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160078 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160082 2535 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160086 2535 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160090 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160094 2535 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160098 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160101 2535 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160105 2535 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160109 2535 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160113 2535 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160116 2535 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160123 2535 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160126 2535 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160130 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160134 2535 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160138 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160142 2535 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160145 2535 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160149 2535 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:02.305021 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.160152 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.160789 2535 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.167584 2535 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.167600 2535 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.167619 2535 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.167625 2535 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167686 2535 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167692 2535 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167695 2535 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167699 2535 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167701 2535 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167705 2535 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167707 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167710 2535 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:02.305890 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167713 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167716 2535 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167719 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167722 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167725 2535 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167730 2535 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167734 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167737 2535 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167740 2535 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167743 2535 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167746 2535 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167748 2535 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167751 2535 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167754 2535 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167757 2535 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167760 2535 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167763 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167765 2535 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167768 2535 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:02.306964 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167770 2535 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167773 2535 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167775 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167778 2535 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167781 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167783 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167786 2535 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167788 2535 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167791 2535 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167794 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167796 2535 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167799 2535 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167801 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167807 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167809 2535 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167812 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167815 2535 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167819 2535 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167823 2535 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167825 2535 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:02.307823 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167828 2535 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167831 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167834 2535 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167837 2535 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167840 2535 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167843 2535 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167846 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167849 2535 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167852 2535 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167854 2535 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167857 2535 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167859 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167862 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167864 2535 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167867 2535 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167870 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167873 2535 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167876 2535 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167878 2535 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167881 2535 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:02.308927 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167883 2535 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167886 2535 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167888 2535 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167891 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167893 2535 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167898 2535 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167900 2535 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167903 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167906 2535 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167908 2535 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167911 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167914 2535 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167916 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167919 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167921 2535 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167924 2535 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167927 2535 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167929 2535 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167933 2535 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167935 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:02.309762 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167938 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167940 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167943 2535 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167945 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167948 2535 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167950 2535 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167953 2535 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167955 2535 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167958 2535 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167960 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167963 2535 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.167966 2535 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.167972 2535 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168101 2535 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:57:02.310851 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168107 2535 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168110 2535 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168114 2535 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168116 2535 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168122 2535 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168126 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168129 2535 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168132 2535 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168135 2535 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168138 2535 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168141 2535 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168144 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168147 2535 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168150 2535 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168153 2535 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168156 2535 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168160 2535 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168162 2535 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168165 2535 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168168 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:57:02.311503 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168170 2535 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168172 2535 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168175 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168178 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168180 2535 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168183 2535 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168186 2535 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168188 2535 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168190 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168193 2535 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168196 2535 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168198 2535 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168200 2535 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168203 2535 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168205 2535 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168208 2535 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168212 2535 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168214 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168217 2535 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168219 2535 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:57:02.312582 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168222 2535 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168224 2535 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168227 2535 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168230 2535 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168233 2535 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168235 2535 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168237 2535 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168240 2535 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168243 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168247 2535 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168250 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168253 2535 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168256 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168259 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168261 2535 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168264 2535 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168266 2535 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168269 2535 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168271 2535 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:57:02.313448 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168274 2535 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168277 2535 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168279 2535 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168282 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168284 2535 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168286 2535 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168289 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168291 2535 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168293 2535 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168297 2535 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168300 2535 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168302 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168306 2535 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168310 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168313 2535 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168316 2535 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168319 2535 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168322 2535 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168324 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:57:02.314322 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168327 2535 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168329 2535 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168333 2535 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168336 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168339 2535 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168341 2535 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168343 2535 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168346 2535 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168349 2535 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168351 2535 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168354 2535 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168356 2535 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168359 2535 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168361 2535 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168364 2535 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168366 2535 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168369 2535 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168371 2535 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168374 2535 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:57:02.315178 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:02.168376 2535 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.168381 2535 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.168486 2535 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.170640 2535 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.171879 2535 server.go:1019] "Starting client certificate rotation" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.174255 2535 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.201155 2535 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.201249 2535 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.202738 2535 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.214468 2535 log.go:25] "Validated CRI v1 runtime API" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.216482 2535 log.go:25] "Validated CRI v1 image API" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.218097 2535 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 16:57:02.316060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.221620 2535 fs.go:135] Filesystem UUIDs: map[1e27abec-c635-4c5f-9a57-6fb50eb8b92b:/dev/nvme0n1p4 67620e9d-396a-4492-8963-06b4d729fac0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 02 16:57:02.316710 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.221642 2535 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.226408 2535 manager.go:216] Machine: {Timestamp:2026-07-02 16:57:02.225337741 +0000 UTC m=+0.329356274 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100364 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c7886d28a89b35bac71fa8032345 SystemUUID:ec28c788-6d28-a89b-35ba-c71fa8032345 BootID:99ec10b4-962f-4346-b971-2d6303d6af11 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:f7:4d:48:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:f7:4d:48:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:d3:02:3c:87:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.226517 2535 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.226617 2535 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.227549 2535 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.227572 2535 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.228285 2535 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.228296 2535 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 16:57:02.316925 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.228303 2535 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.229030 2535 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.230031 2535 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.230990 2535 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234067 2535 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234181 2535 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234212 2535 kubelet.go:486] "Attempting to sync node with API server" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234225 2535 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234244 2535 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234257 2535 kubelet.go:398] "Adding apiserver pod source" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234269 2535 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234713 2535 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.234729 2535 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.236644 2535 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.238324 2535 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.238354 2535 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239076 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239090 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239096 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239101 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239109 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239114 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239122 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239127 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239134 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239139 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239147 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239152 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239176 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.239182 2535 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.242313 2535 server.go:1268] "Started kubelet" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.242396 2535 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.242414 2535 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.242453 2535 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.247656 2535 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.247805 2535 server.go:310] "Adding debug handlers to kubelet server" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.250214 2535 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.253664 2535 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.253718 2535 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 16:57:02.317366 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.254241 2535 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.255170 2535 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ftbch" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.255907 2535 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-105.ec2.internal.18be877115372628 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-105.ec2.internal,UID:ip-10-0-128-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-105.ec2.internal,},FirstTimestamp:2026-07-02 16:57:02.242285096 +0000 UTC m=+0.346303629,LastTimestamp:2026-07-02 16:57:02.242285096 +0000 UTC m=+0.346303629,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-105.ec2.internal,}" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.260410 2535 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.260433 2535 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.260497 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.260954 2535 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ftbch" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261046 2535 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261061 2535 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261234 2535 reconstruct.go:97] "Volume reconstruction finished" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261254 2535 reconciler.go:29] "Reconciler: start to sync state" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261277 2535 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261745 2535 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261759 2535 factory.go:55] Registering systemd factory Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261768 2535 factory.go:223] Registration of the systemd container factory successfully Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261970 2535 factory.go:153] Registering CRI-O factory Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.261982 2535 factory.go:223] Registration of the crio container factory successfully Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.262006 2535 factory.go:103] Registering Raw factory Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.262022 2535 manager.go:1196] Started watching for new ooms in manager Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.262413 2535 manager.go:349] Starting recovery of all containers Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.270203 2535 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.270345 2535 manager.go:354] Recovery completed Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.274723 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.275469 2535 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.275489 2535 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.277021 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.277048 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.277061 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.277892 2535 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.277900 2535 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.277914 2535 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.278060 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.280654 2535 policy_none.go:49] "None policy: Start" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.280668 2535 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 16:57:02.319114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.280678 2535 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 16:57:02.323136 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.282029 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.323136 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.282050 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.323136 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.282061 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.323136 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.282803 2535 policy_none.go:47] "Start" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.355086 2535 manager.go:337] "Starting Device Plugin manager" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.355381 2535 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.355394 2535 server.go:87] "Starting device plugin registration server" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.355669 2535 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.355682 2535 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.355942 2535 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.356018 2535 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.356027 2535 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.356759 2535 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.356825 2535 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.382816 2535 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.382853 2535 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.382875 2535 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.382915 2535 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.385534 2535 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.456973 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.458202 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.458238 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.458251 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.458283 2535 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.466828 2535 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.482761 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.466849 2535 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-105.ec2.internal\": node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.484644 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.483619 2535 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal"] Jul 02 16:57:02.484644 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.483686 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.484998 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.484672 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.484998 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.484702 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.484998 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.484717 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.485334 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.485252 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.487264 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.487373 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.487402 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.488066 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.488091 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.488101 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.488116 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.488139 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.488151 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.490474 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.490496 2535 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.491221 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.491252 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.491262 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.517347 2535 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-105.ec2.internal\" not found" node="ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.522392 2535 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-105.ec2.internal\" not found" node="ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.562679 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/759b7e374782897a446d86b0b6a5b5ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"759b7e374782897a446d86b0b6a5b5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.562710 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/759b7e374782897a446d86b0b6a5b5ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"759b7e374782897a446d86b0b6a5b5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.562727 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50c016c0fd8f941ebe04fa7023a3cc06-config\") pod \"kube-apiserver-proxy-ip-10-0-128-105.ec2.internal\" (UID: \"50c016c0fd8f941ebe04fa7023a3cc06\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.631473 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.585613 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.663468 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/759b7e374782897a446d86b0b6a5b5ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"759b7e374782897a446d86b0b6a5b5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.663498 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50c016c0fd8f941ebe04fa7023a3cc06-config\") pod \"kube-apiserver-proxy-ip-10-0-128-105.ec2.internal\" (UID: \"50c016c0fd8f941ebe04fa7023a3cc06\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.663516 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/759b7e374782897a446d86b0b6a5b5ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"759b7e374782897a446d86b0b6a5b5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.663577 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/759b7e374782897a446d86b0b6a5b5ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"759b7e374782897a446d86b0b6a5b5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.663608 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/50c016c0fd8f941ebe04fa7023a3cc06-config\") pod \"kube-apiserver-proxy-ip-10-0-128-105.ec2.internal\" (UID: \"50c016c0fd8f941ebe04fa7023a3cc06\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.663661 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/759b7e374782897a446d86b0b6a5b5ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"759b7e374782897a446d86b0b6a5b5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.687353 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.822590 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.789370 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:02.824202 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.824127 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:03.015986 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:02.826431 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jul 02 16:57:03.015986 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.889931 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:03.015986 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:02.991102 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:03.173119 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.092280 2535 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jul 02 16:57:03.173119 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.145906 2535 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:03.173119 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.160906 2535 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jul 02 16:57:03.173119 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.170885 2535 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:57:03.173119 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.172612 2535 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.183764 2535 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.201812 2535 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.201957 2535 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.234454 2535 apiserver.go:52] "Watching apiserver" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.242716 2535 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.243049 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4m766","kube-system/konnectivity-agent-btkps","kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd","openshift-multus/multus-additional-cni-plugins-7xsbc","openshift-network-diagnostics/network-check-target-tkrht","openshift-network-operator/iptables-alerter-jl849","openshift-ovn-kubernetes/ovnkube-node-kn8gx","openshift-cluster-node-tuning-operator/tuned-ltmf5","openshift-dns/node-resolver-6s8q7","openshift-image-registry/node-ca-kggjg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal","openshift-multus/multus-ldshb","openshift-multus/network-metrics-daemon-ls4jm"] Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.245585 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.247825 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.248182 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.248254 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.248261 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-59qcx\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.248339 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.249985 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.249995 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jd5tb\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.249993 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.250047 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.250239 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.250271 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.250328 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.252805 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.255637 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.256714 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.256750 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.256750 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.256860 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wk22h\"" Jul 02 16:57:03.329269 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.257954 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5nnvx\"" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.258046 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.258117 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.258223 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.258305 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.260523 2535 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.260528 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.262792 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.262819 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.262798 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fz57q\"" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.263060 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.263117 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.265702 2535 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 16:52:02 +0000 UTC" deadline="2028-02-06 09:18:32.425239664 +0000 UTC" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.265743 2535 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14008h21m29.159499763s" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.265923 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267114 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-system-cni-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267146 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cnibin\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267173 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4b87\" (UniqueName: \"kubernetes.io/projected/5e838d83-8c62-4634-b636-ac3ccd4991a1-kube-api-access-x4b87\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267198 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysctl-d\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267221 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-systemd\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.331043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267237 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267271 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mtmc\" (UniqueName: \"kubernetes.io/projected/a4b50285-ce97-4aa4-a352-13f8603f0ca6-kube-api-access-7mtmc\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267303 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gmp\" (UniqueName: \"kubernetes.io/projected/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-kube-api-access-q9gmp\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267352 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267379 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27kk9\" (UniqueName: \"kubernetes.io/projected/8543655c-b98c-49a3-8cd7-a584e82e8808-kube-api-access-27kk9\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267398 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-multus-certs\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267433 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267456 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-device-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267476 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-host\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267499 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-tuned\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267520 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/445acc05-aa49-4cc4-839a-c72e7016c4a3-kubelet-config\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267536 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-conf-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267565 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.332257 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267595 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-kubernetes\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267623 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-os-release\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267649 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-k8s-cni-cncf-io\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267666 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-cni-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267707 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-netns\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267733 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-system-cni-dir\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267759 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267794 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2b82072-76b9-4e75-98de-e78f3f7b0c31-cni-binary-copy\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267818 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-etc-kubernetes\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267833 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-run\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267867 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/445acc05-aa49-4cc4-839a-c72e7016c4a3-dbus\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267896 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-hostroot\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267925 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysconfig\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267942 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-socket-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.333052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.267969 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-cni-multus\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268006 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268028 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-registration-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268046 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-sys-fs\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268068 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-modprobe-d\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268089 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-kubelet\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268109 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-iptables-alerter-script\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268139 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-cnibin\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268162 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jbqz\" (UniqueName: \"kubernetes.io/projected/c2b82072-76b9-4e75-98de-e78f3f7b0c31-kube-api-access-6jbqz\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268170 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268182 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-os-release\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268200 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268217 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268260 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8543655c-b98c-49a3-8cd7-a584e82e8808-tmp\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268293 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 16:57:03.334881 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268294 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-socket-dir-parent\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268321 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rvxnr\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268332 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-cni-bin\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268360 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysctl-conf\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268383 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-sys\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268408 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268448 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-var-lib-kubelet\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268475 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-host-slash\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268502 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-lib-modules\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268526 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-daemon-config\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268550 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9rnj\" (UniqueName: \"kubernetes.io/projected/8c4e6563-c355-4c14-acd4-b2b1b8981e11-kube-api-access-x9rnj\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.268605 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.271521 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.274353 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279680 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279709 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279727 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279770 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279777 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jf8k9\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279806 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279839 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.335812 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279680 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.279923 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.280145 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snqsg\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.280171 2535 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.280210 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nsfc2\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.280259 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.280782 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.280842 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.299181 2535 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zpwvc" Jul 02 16:57:03.336996 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.313809 2535 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zpwvc" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.362444 2535 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368805 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-system-cni-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368846 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cnibin\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368878 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4b87\" (UniqueName: \"kubernetes.io/projected/5e838d83-8c62-4634-b636-ac3ccd4991a1-kube-api-access-x4b87\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368909 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-ovn\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368935 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-log-socket\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368948 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-system-cni-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368961 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysctl-d\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.368957 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cnibin\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369008 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-systemd\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369054 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369077 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-systemd\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369107 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysctl-d\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369125 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mtmc\" (UniqueName: \"kubernetes.io/projected/a4b50285-ce97-4aa4-a352-13f8603f0ca6-kube-api-access-7mtmc\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.467529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369236 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-systemd\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369353 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-env-overrides\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369388 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gmp\" (UniqueName: \"kubernetes.io/projected/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-kube-api-access-q9gmp\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369556 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369588 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27kk9\" (UniqueName: \"kubernetes.io/projected/8543655c-b98c-49a3-8cd7-a584e82e8808-kube-api-access-27kk9\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369626 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-multus-certs\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369682 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-multus-certs\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369686 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369725 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-device-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369761 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxvd\" (UniqueName: \"kubernetes.io/projected/fcf543f6-e108-478f-8250-0e809a1753b9-kube-api-access-snxvd\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369811 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-device-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369847 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-host\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369875 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-tuned\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369898 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/445acc05-aa49-4cc4-839a-c72e7016c4a3-kubelet-config\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.469538 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369915 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369919 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-conf-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369959 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-conf-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369961 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369972 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/445acc05-aa49-4cc4-839a-c72e7016c4a3-kubelet-config\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369988 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-host\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.369997 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4aaf5b2d-da3d-47e4-beb8-918c342285a0-hosts-file\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370037 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovnkube-config\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370072 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95hr6\" (UniqueName: \"kubernetes.io/projected/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-kube-api-access-95hr6\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370101 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-kubernetes\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370128 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-os-release\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370152 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-k8s-cni-cncf-io\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370178 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/851cca5b-69a9-4277-9dec-ea72cf625217-konnectivity-ca\") pod \"konnectivity-agent-btkps\" (UID: \"851cca5b-69a9-4277-9dec-ea72cf625217\") " pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370204 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-cni-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370208 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-k8s-cni-cncf-io\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.470979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370213 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-os-release\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370178 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-kubernetes\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370228 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-netns\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370255 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-system-cni-dir\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370279 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-node-log\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370303 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370328 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2b82072-76b9-4e75-98de-e78f3f7b0c31-cni-binary-copy\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370352 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-etc-kubernetes\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370356 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-run-netns\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370355 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-system-cni-dir\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370376 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqlvz\" (UniqueName: \"kubernetes.io/projected/4aaf5b2d-da3d-47e4-beb8-918c342285a0-kube-api-access-sqlvz\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.370399 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370415 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-cni-dir\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370417 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-etc-kubernetes\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.472342 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370437 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-run-netns\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.370467 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.870449568 +0000 UTC m=+1.974468089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370483 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-etc-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370503 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370531 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-run\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370614 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-run\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370615 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/445acc05-aa49-4cc4-839a-c72e7016c4a3-dbus\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370650 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-hostroot\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370676 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/851cca5b-69a9-4277-9dec-ea72cf625217-agent-certs\") pod \"konnectivity-agent-btkps\" (UID: \"851cca5b-69a9-4277-9dec-ea72cf625217\") " pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370679 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/445acc05-aa49-4cc4-839a-c72e7016c4a3-dbus\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370712 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-hostroot\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370702 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaf5b2d-da3d-47e4-beb8-918c342285a0-tmp-dir\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370750 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-var-lib-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370779 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-cni-bin\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.473574 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370805 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysconfig\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370831 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-socket-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370855 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-cni-multus\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370881 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370906 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-registration-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.370953 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-sys-fs\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371003 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371033 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-modprobe-d\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371062 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-kubelet\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371073 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-socket-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371084 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-cni-netd\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371090 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2b82072-76b9-4e75-98de-e78f3f7b0c31-cni-binary-copy\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371109 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-iptables-alerter-script\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371130 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-cnibin\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371147 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysconfig\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.475024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371147 2535 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371166 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jbqz\" (UniqueName: \"kubernetes.io/projected/c2b82072-76b9-4e75-98de-e78f3f7b0c31-kube-api-access-6jbqz\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371190 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-os-release\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371194 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-cni-multus\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371212 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371213 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-kubelet\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371236 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovnkube-script-lib\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371244 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371254 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371252 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371288 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371284 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8543655c-b98c-49a3-8cd7-a584e82e8808-tmp\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371346 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-modprobe-d\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371387 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-registration-dir\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.475985 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371419 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-cnibin\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371457 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-socket-dir-parent\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371460 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371487 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-cni-bin\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371523 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-host-var-lib-cni-bin\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371547 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e838d83-8c62-4634-b636-ac3ccd4991a1-sys-fs\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371596 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-socket-dir-parent\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371595 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-kubelet\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371644 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysctl-conf\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371670 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-sys\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371697 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371723 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-slash\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371775 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovn-node-metrics-cert\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371783 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-sysctl-conf\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.476880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371807 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-var-lib-kubelet\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371833 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-host-slash\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371858 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fcf543f6-e108-478f-8250-0e809a1753b9-host\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.371871 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371883 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fcf543f6-e108-478f-8250-0e809a1753b9-serviceca\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371901 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4b50285-ce97-4aa4-a352-13f8603f0ca6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371908 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-systemd-units\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371914 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-iptables-alerter-script\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.371930 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.871912041 +0000 UTC m=+1.975930563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371958 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-sys\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.371993 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4b50285-ce97-4aa4-a352-13f8603f0ca6-os-release\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372009 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-host-slash\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372014 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-lib-modules\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372046 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-var-lib-kubelet\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.477822 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372061 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-daemon-config\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372095 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8543655c-b98c-49a3-8cd7-a584e82e8808-lib-modules\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372098 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9rnj\" (UniqueName: \"kubernetes.io/projected/8c4e6563-c355-4c14-acd4-b2b1b8981e11-kube-api-access-x9rnj\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372143 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.372452 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2b82072-76b9-4e75-98de-e78f3f7b0c31-multus-daemon-config\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.374705 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8543655c-b98c-49a3-8cd7-a584e82e8808-tmp\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.374731 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8543655c-b98c-49a3-8cd7-a584e82e8808-etc-tuned\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.375495 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.375520 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.375534 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.375625 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.875607835 +0000 UTC m=+1.979626363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.377936 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27kk9\" (UniqueName: \"kubernetes.io/projected/8543655c-b98c-49a3-8cd7-a584e82e8808-kube-api-access-27kk9\") pod \"tuned-ltmf5\" (UID: \"8543655c-b98c-49a3-8cd7-a584e82e8808\") " pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.378394 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4b87\" (UniqueName: \"kubernetes.io/projected/5e838d83-8c62-4634-b636-ac3ccd4991a1-kube-api-access-x4b87\") pod \"aws-ebs-csi-driver-node-wddcd\" (UID: \"5e838d83-8c62-4634-b636-ac3ccd4991a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.380204 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gmp\" (UniqueName: \"kubernetes.io/projected/c01ab504-69ff-450e-8e7f-2f2304fd1b0c-kube-api-access-q9gmp\") pod \"iptables-alerter-jl849\" (UID: \"c01ab504-69ff-450e-8e7f-2f2304fd1b0c\") " pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.478550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.386677 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jbqz\" (UniqueName: \"kubernetes.io/projected/c2b82072-76b9-4e75-98de-e78f3f7b0c31-kube-api-access-6jbqz\") pod \"multus-ldshb\" (UID: \"c2b82072-76b9-4e75-98de-e78f3f7b0c31\") " pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.386690 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9rnj\" (UniqueName: \"kubernetes.io/projected/8c4e6563-c355-4c14-acd4-b2b1b8981e11-kube-api-access-x9rnj\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.399379 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mtmc\" (UniqueName: \"kubernetes.io/projected/a4b50285-ce97-4aa4-a352-13f8603f0ca6-kube-api-access-7mtmc\") pod \"multus-additional-cni-plugins-7xsbc\" (UID: \"a4b50285-ce97-4aa4-a352-13f8603f0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.411451 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.470681 2535 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472475 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fcf543f6-e108-478f-8250-0e809a1753b9-serviceca\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472500 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-systemd-units\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472521 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472547 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-ovn\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472570 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-log-socket\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472604 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-systemd-units\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472625 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-ovn\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472633 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472635 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-log-socket\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472831 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-systemd\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472848 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-env-overrides\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.479507 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472921 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-systemd\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.472994 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snxvd\" (UniqueName: \"kubernetes.io/projected/fcf543f6-e108-478f-8250-0e809a1753b9-kube-api-access-snxvd\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473047 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fcf543f6-e108-478f-8250-0e809a1753b9-serviceca\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473085 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4aaf5b2d-da3d-47e4-beb8-918c342285a0-hosts-file\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473116 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovnkube-config\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473144 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95hr6\" (UniqueName: \"kubernetes.io/projected/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-kube-api-access-95hr6\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473172 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/851cca5b-69a9-4277-9dec-ea72cf625217-konnectivity-ca\") pod \"konnectivity-agent-btkps\" (UID: \"851cca5b-69a9-4277-9dec-ea72cf625217\") " pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473201 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-node-log\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473246 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlvz\" (UniqueName: \"kubernetes.io/projected/4aaf5b2d-da3d-47e4-beb8-918c342285a0-kube-api-access-sqlvz\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473294 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-run-netns\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473356 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-etc-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473383 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473412 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/851cca5b-69a9-4277-9dec-ea72cf625217-agent-certs\") pod \"konnectivity-agent-btkps\" (UID: \"851cca5b-69a9-4277-9dec-ea72cf625217\") " pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473439 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaf5b2d-da3d-47e4-beb8-918c342285a0-tmp-dir\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473467 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-var-lib-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.480725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473473 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-node-log\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473494 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-cni-bin\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473507 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4aaf5b2d-da3d-47e4-beb8-918c342285a0-hosts-file\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473520 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-etc-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473525 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473570 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-run-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473579 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473619 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-cni-netd\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473627 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-var-lib-openvswitch\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473572 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-cni-netd\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473704 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovnkube-script-lib\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473735 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-kubelet\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473777 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-slash\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473803 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovn-node-metrics-cert\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473831 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fcf543f6-e108-478f-8250-0e809a1753b9-host\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.481901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473899 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fcf543f6-e108-478f-8250-0e809a1753b9-host\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473940 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aaf5b2d-da3d-47e4-beb8-918c342285a0-tmp-dir\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474000 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-cni-bin\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.473431 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-run-netns\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474064 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-kubelet\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474069 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-env-overrides\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474131 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-host-slash\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474394 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovnkube-script-lib\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474606 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovnkube-config\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.474661 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/851cca5b-69a9-4277-9dec-ea72cf625217-konnectivity-ca\") pod \"konnectivity-agent-btkps\" (UID: \"851cca5b-69a9-4277-9dec-ea72cf625217\") " pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.476277 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/851cca5b-69a9-4277-9dec-ea72cf625217-agent-certs\") pod \"konnectivity-agent-btkps\" (UID: \"851cca5b-69a9-4277-9dec-ea72cf625217\") " pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.476859 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-ovn-node-metrics-cert\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.480640 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqlvz\" (UniqueName: \"kubernetes.io/projected/4aaf5b2d-da3d-47e4-beb8-918c342285a0-kube-api-access-sqlvz\") pod \"node-resolver-6s8q7\" (UID: \"4aaf5b2d-da3d-47e4-beb8-918c342285a0\") " pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.481971 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxvd\" (UniqueName: \"kubernetes.io/projected/fcf543f6-e108-478f-8250-0e809a1753b9-kube-api-access-snxvd\") pod \"node-ca-kggjg\" (UID: \"fcf543f6-e108-478f-8250-0e809a1753b9\") " pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.484932 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.483407 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95hr6\" (UniqueName: \"kubernetes.io/projected/4f8cd8bd-cb03-43bf-8c17-01f69d1bb358-kube-api-access-95hr6\") pod \"ovnkube-node-kn8gx\" (UID: \"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.510815 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759b7e374782897a446d86b0b6a5b5ff.slice/crio-1795919ac294bdadb29616309d907618a34b389238a23bfcacc357a8fbc115a2 WatchSource:0}: Error finding container 1795919ac294bdadb29616309d907618a34b389238a23bfcacc357a8fbc115a2: Status 404 returned error can't find the container with id 1795919ac294bdadb29616309d907618a34b389238a23bfcacc357a8fbc115a2 Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.513075 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c016c0fd8f941ebe04fa7023a3cc06.slice/crio-1813bfe3bde1b01b424aec9ed7039e5c0f4d1e6ebf56c0af114193deb1ecc32b WatchSource:0}: Error finding container 1813bfe3bde1b01b424aec9ed7039e5c0f4d1e6ebf56c0af114193deb1ecc32b: Status 404 returned error can't find the container with id 1813bfe3bde1b01b424aec9ed7039e5c0f4d1e6ebf56c0af114193deb1ecc32b Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.515110 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.515358 2535 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.525272 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8cd8bd_cb03_43bf_8c17_01f69d1bb358.slice/crio-21ff0ae0e357cef4ccc8890fb18c79ba39478f36a677659280fc716cf8304411 WatchSource:0}: Error finding container 21ff0ae0e357cef4ccc8890fb18c79ba39478f36a677659280fc716cf8304411: Status 404 returned error can't find the container with id 21ff0ae0e357cef4ccc8890fb18c79ba39478f36a677659280fc716cf8304411 Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.601108 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jl849" Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.615142 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01ab504_69ff_450e_8e7f_2f2304fd1b0c.slice/crio-39a68739959afc43b2733054fb55c636dbaa437687101c9b97bca881f80a57bb WatchSource:0}: Error finding container 39a68739959afc43b2733054fb55c636dbaa437687101c9b97bca881f80a57bb: Status 404 returned error can't find the container with id 39a68739959afc43b2733054fb55c636dbaa437687101c9b97bca881f80a57bb Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.620414 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ldshb" Jul 02 16:57:03.654681 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.629797 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b82072_76b9_4e75_98de_e78f3f7b0c31.slice/crio-f5662d22459ea211c87238257f05f73218e8de094a05d4b12b1adcafbc636efa WatchSource:0}: Error finding container f5662d22459ea211c87238257f05f73218e8de094a05d4b12b1adcafbc636efa: Status 404 returned error can't find the container with id f5662d22459ea211c87238257f05f73218e8de094a05d4b12b1adcafbc636efa Jul 02 16:57:03.673455 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.671997 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" Jul 02 16:57:03.676039 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.675076 2535 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.680859 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e838d83_8c62_4634_b636_ac3ccd4991a1.slice/crio-d3d9089c66dbb48cd3b33c4d379712732e6439ae3cc363cddf6361ec548e2918 WatchSource:0}: Error finding container d3d9089c66dbb48cd3b33c4d379712732e6439ae3cc363cddf6361ec548e2918: Status 404 returned error can't find the container with id d3d9089c66dbb48cd3b33c4d379712732e6439ae3cc363cddf6361ec548e2918 Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.688167 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.696806 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b50285_ce97_4aa4_a352_13f8603f0ca6.slice/crio-6163a6009e152ac6d6ecfeef9ae9770c1eb0349a11f2722bf15d0461d8c13a87 WatchSource:0}: Error finding container 6163a6009e152ac6d6ecfeef9ae9770c1eb0349a11f2722bf15d0461d8c13a87: Status 404 returned error can't find the container with id 6163a6009e152ac6d6ecfeef9ae9770c1eb0349a11f2722bf15d0461d8c13a87 Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.740527 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.745656 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6s8q7" Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.749351 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851cca5b_69a9_4277_9dec_ea72cf625217.slice/crio-03b15e6df5ed668f393727e52f3c7fb5221126d38b1b9c52769620cf1d85c191 WatchSource:0}: Error finding container 03b15e6df5ed668f393727e52f3c7fb5221126d38b1b9c52769620cf1d85c191: Status 404 returned error can't find the container with id 03b15e6df5ed668f393727e52f3c7fb5221126d38b1b9c52769620cf1d85c191 Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.754439 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aaf5b2d_da3d_47e4_beb8_918c342285a0.slice/crio-ecd30444b100a4ab33629cf566c9a895b8a5d5bc7c4fd0b999b78b6042ed9711 WatchSource:0}: Error finding container ecd30444b100a4ab33629cf566c9a895b8a5d5bc7c4fd0b999b78b6042ed9711: Status 404 returned error can't find the container with id ecd30444b100a4ab33629cf566c9a895b8a5d5bc7c4fd0b999b78b6042ed9711 Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.762956 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kggjg" Jul 02 16:57:03.827701 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.772953 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf543f6_e108_478f_8250_0e809a1753b9.slice/crio-ffba33ae22839e205ada14db6d61f7358e552ec89952d962f02bce9357fed8aa WatchSource:0}: Error finding container ffba33ae22839e205ada14db6d61f7358e552ec89952d962f02bce9357fed8aa: Status 404 returned error can't find the container with id ffba33ae22839e205ada14db6d61f7358e552ec89952d962f02bce9357fed8aa Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:03.868719 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8543655c_b98c_49a3_8cd7_a584e82e8808.slice/crio-b998d13a0911b95df293c5ae2615ca86f6735541e14d6d5a075f28346c7edb91 WatchSource:0}: Error finding container b998d13a0911b95df293c5ae2615ca86f6735541e14d6d5a075f28346c7edb91: Status 404 returned error can't find the container with id b998d13a0911b95df293c5ae2615ca86f6735541e14d6d5a075f28346c7edb91 Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.878035 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.878074 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:03.878103 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878196 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878264 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:04.878243316 +0000 UTC m=+2.982261843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878196 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878301 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:04.87829384 +0000 UTC m=+2.982312361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878202 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878329 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878342 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:03.980124 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:03.878374 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:04.878366342 +0000 UTC m=+2.982384865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:04.317407 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.317324 2535 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:52:03 +0000 UTC" deadline="2028-02-10 11:14:18.0367792 +0000 UTC" Jul 02 16:57:04.317407 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.317391 2535 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14106h17m13.719392352s" Jul 02 16:57:04.400313 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.400111 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:04.400313 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.400242 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:04.401671 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.400768 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:04.401671 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.400885 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:04.417655 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.417583 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-btkps" event={"ID":"851cca5b-69a9-4277-9dec-ea72cf625217","Type":"ContainerStarted","Data":"03b15e6df5ed668f393727e52f3c7fb5221126d38b1b9c52769620cf1d85c191"} Jul 02 16:57:04.440302 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.440178 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" event={"ID":"5e838d83-8c62-4634-b636-ac3ccd4991a1","Type":"ContainerStarted","Data":"d3d9089c66dbb48cd3b33c4d379712732e6439ae3cc363cddf6361ec548e2918"} Jul 02 16:57:04.453307 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.453148 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jl849" event={"ID":"c01ab504-69ff-450e-8e7f-2f2304fd1b0c","Type":"ContainerStarted","Data":"39a68739959afc43b2733054fb55c636dbaa437687101c9b97bca881f80a57bb"} Jul 02 16:57:04.468691 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.468656 2535 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:57:04.474080 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.472875 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" event={"ID":"759b7e374782897a446d86b0b6a5b5ff","Type":"ContainerStarted","Data":"1795919ac294bdadb29616309d907618a34b389238a23bfcacc357a8fbc115a2"} Jul 02 16:57:04.486876 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.486839 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kggjg" event={"ID":"fcf543f6-e108-478f-8250-0e809a1753b9","Type":"ContainerStarted","Data":"ffba33ae22839e205ada14db6d61f7358e552ec89952d962f02bce9357fed8aa"} Jul 02 16:57:04.491069 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.491035 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerStarted","Data":"6163a6009e152ac6d6ecfeef9ae9770c1eb0349a11f2722bf15d0461d8c13a87"} Jul 02 16:57:04.496270 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.496238 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ldshb" event={"ID":"c2b82072-76b9-4e75-98de-e78f3f7b0c31","Type":"ContainerStarted","Data":"f5662d22459ea211c87238257f05f73218e8de094a05d4b12b1adcafbc636efa"} Jul 02 16:57:04.529367 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.529328 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"21ff0ae0e357cef4ccc8890fb18c79ba39478f36a677659280fc716cf8304411"} Jul 02 16:57:04.542612 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.542576 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" event={"ID":"50c016c0fd8f941ebe04fa7023a3cc06","Type":"ContainerStarted","Data":"1813bfe3bde1b01b424aec9ed7039e5c0f4d1e6ebf56c0af114193deb1ecc32b"} Jul 02 16:57:04.559868 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.559831 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" event={"ID":"8543655c-b98c-49a3-8cd7-a584e82e8808","Type":"ContainerStarted","Data":"b998d13a0911b95df293c5ae2615ca86f6735541e14d6d5a075f28346c7edb91"} Jul 02 16:57:04.582619 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.582581 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6s8q7" event={"ID":"4aaf5b2d-da3d-47e4-beb8-918c342285a0","Type":"ContainerStarted","Data":"ecd30444b100a4ab33629cf566c9a895b8a5d5bc7c4fd0b999b78b6042ed9711"} Jul 02 16:57:04.891535 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.891443 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:04.891535 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.891520 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:04.891789 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:04.891582 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:04.891789 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.891721 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:04.891789 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.891782 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:06.891764689 +0000 UTC m=+4.995783216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:04.892186 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.892166 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:04.892262 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.892220 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:06.892204964 +0000 UTC m=+4.996223491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:04.892344 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.892329 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:04.892399 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.892350 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:04.892399 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.892363 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:04.892504 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:04.892443 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:06.892426977 +0000 UTC m=+4.996445519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:05.318231 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:05.318138 2535 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:52:03 +0000 UTC" deadline="2028-03-27 03:45:54.227679346 +0000 UTC" Jul 02 16:57:05.318231 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:05.318181 2535 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15202h48m48.909503214s" Jul 02 16:57:05.383321 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:05.383288 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:05.383510 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:05.383420 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:06.388606 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:06.386560 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:06.388606 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.386681 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:06.388606 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:06.387071 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:06.388606 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.387165 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:06.909216 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:06.909160 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:06.909390 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:06.909229 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:06.909390 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:06.909271 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:06.909567 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909400 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:06.909567 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909467 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:10.909448048 +0000 UTC m=+9.013466585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:06.909567 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909553 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:06.909821 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909589 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:10.909576336 +0000 UTC m=+9.013594859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:06.909821 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909672 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:06.909821 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909688 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:06.909821 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909701 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:06.909821 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:06.909734 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:10.909723308 +0000 UTC m=+9.013741835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:07.383305 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:07.383227 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:07.383465 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:07.383363 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:08.388249 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:08.387789 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:08.388249 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:08.387914 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:08.388249 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:08.387956 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:08.388249 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:08.388077 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:09.384079 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:09.383734 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:09.384079 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:09.383857 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:10.387614 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:10.387582 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:10.388048 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.387702 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:10.388048 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:10.387745 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:10.388048 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.387843 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:10.944349 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:10.944415 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:10.944470 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944602 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944666 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:18.944646976 +0000 UTC m=+17.048665500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944753 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944770 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944786 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944848 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:18.944833722 +0000 UTC m=+17.048852251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944861 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:10.945049 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:10.944933 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:18.944911956 +0000 UTC m=+17.048930487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:11.383829 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:11.383746 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:11.383983 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:11.383886 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:12.385482 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:12.385011 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:12.385482 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:12.385132 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:12.385482 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:12.385195 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:12.385482 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:12.385310 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:13.383605 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:13.383561 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:13.383781 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:13.383689 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:14.383182 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:14.383148 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:14.383625 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:14.383286 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:14.383625 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:14.383362 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:14.383625 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:14.383470 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:15.383760 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:15.383730 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:15.384095 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:15.383822 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:16.383305 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:16.383268 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:16.383475 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:16.383280 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:16.383475 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:16.383407 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:16.383618 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:16.383495 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:17.383994 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:17.383963 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:17.384445 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:17.384081 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:18.383769 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:18.383736 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:18.383769 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:18.383768 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:18.383996 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:18.383887 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:18.384128 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:18.384100 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:19.006162 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:19.006122 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:19.006162 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:19.006181 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:19.006207 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006283 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006371 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:35.006351008 +0000 UTC m=+33.110369530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006375 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006390 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006293 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006402 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:19.006434 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006439 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:35.006427421 +0000 UTC m=+33.110445959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:19.006799 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.006456 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:35.006446776 +0000 UTC m=+33.110465302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:19.383183 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:19.383092 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:19.383343 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:19.383220 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:20.383851 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:20.383815 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:20.384303 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:20.383962 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:20.384303 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:20.384017 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:20.384303 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:20.384143 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:21.383322 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:21.383118 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:21.383466 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:21.383401 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:22.383739 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:22.383711 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:22.384073 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:22.383805 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:22.384073 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:22.383886 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:22.384073 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:22.383991 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:23.383594 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:23.383555 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:23.383784 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:23.383682 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:24.383151 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.383083 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:24.383304 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:24.383195 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:24.383304 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.383262 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:24.383413 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:24.383371 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:24.658777 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.658742 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ldshb" event={"ID":"c2b82072-76b9-4e75-98de-e78f3f7b0c31","Type":"ContainerStarted","Data":"40c5b251d5573e0bfa4bdb4fd92f1550ee188ad0c153315ef59079ae200db185"} Jul 02 16:57:24.662901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.662883 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 16:57:24.663293 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.663272 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"56cc708a5e71d8aa0380857c567cbbb0bc2bc8f1408cec65698ff96b235ddb7a"} Jul 02 16:57:24.663361 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.663349 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"25acab2b58e7616a1642d5b51368758c7a77aac46ceb656a8ab91579b54e2959"} Jul 02 16:57:24.664735 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.664710 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" event={"ID":"50c016c0fd8f941ebe04fa7023a3cc06","Type":"ContainerStarted","Data":"ed87d6cd659b94588c1f09953b25c241ca9f4be9e83350a399acf1a5ced34fe7"} Jul 02 16:57:24.666002 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.665978 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" event={"ID":"8543655c-b98c-49a3-8cd7-a584e82e8808","Type":"ContainerStarted","Data":"26f7892e0bbe432c73f896b6cd8baa7207463293ef6c6433042255653335e9e1"} Jul 02 16:57:24.677141 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.677077 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ldshb" podStartSLOduration=2.267109768 podStartE2EDuration="22.677059588s" totalImagesPullingTime="20.40994982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:24.675902692 +0000 UTC m=+22.779921277" watchObservedRunningTime="2026-07-02 16:57:24.677059588 +0000 UTC m=+22.781078130" Jul 02 16:57:24.692479 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.692436 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ltmf5" podStartSLOduration=2.538788073 podStartE2EDuration="22.692422163s" totalImagesPullingTime="20.15363409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:24.691614654 +0000 UTC m=+22.795633197" watchObservedRunningTime="2026-07-02 16:57:24.692422163 +0000 UTC m=+22.796440704" Jul 02 16:57:24.704475 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:24.704436 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" podStartSLOduration=21.704426367 podStartE2EDuration="21.704426367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:24.703939487 +0000 UTC m=+22.807958028" watchObservedRunningTime="2026-07-02 16:57:24.704426367 +0000 UTC m=+22.808444909" Jul 02 16:57:25.383210 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.383039 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:25.383420 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:25.383285 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:25.669027 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.669001 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerStarted","Data":"e97bd30349769f80ea3c32602a493dac37ae3bf5652a16428f3dc793ebbf61fd"} Jul 02 16:57:25.671833 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.671817 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 16:57:25.672163 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.672141 2535 generic.go:356] "Generic (PLEG): container finished" podID="4f8cd8bd-cb03-43bf-8c17-01f69d1bb358" containerID="56cc708a5e71d8aa0380857c567cbbb0bc2bc8f1408cec65698ff96b235ddb7a" exitCode=1 Jul 02 16:57:25.672222 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.672206 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerDied","Data":"56cc708a5e71d8aa0380857c567cbbb0bc2bc8f1408cec65698ff96b235ddb7a"} Jul 02 16:57:25.672295 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.672280 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"fd8ae863489886e5f32dcc57f160011a69a126c049e9aa38039210071be70314"} Jul 02 16:57:25.672334 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.672324 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"6ac12c6a45708ea4c5436ed44cee36acacacfc9295f9988187c2a505c2875f9c"} Jul 02 16:57:25.672376 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.672368 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"f18b91be2e1dad7fc2472edb047825c623ee8d6cbee975e35cdc6feceaa11aa3"} Jul 02 16:57:25.672427 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.672417 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"419700b8193d5038aec539e6c669ac825afa2fa848ef0f6d3c8d4807376160b2"} Jul 02 16:57:25.673708 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.673665 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6s8q7" event={"ID":"4aaf5b2d-da3d-47e4-beb8-918c342285a0","Type":"ContainerStarted","Data":"3ef43a6eff78b3f8a77807573f1a3479b3aa415e464de0a86b8d32939600a48a"} Jul 02 16:57:25.675024 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.675004 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-btkps" event={"ID":"851cca5b-69a9-4277-9dec-ea72cf625217","Type":"ContainerStarted","Data":"323af9f5f168fa9058be77c0a2546f93c7216a49946e7a917693271448d5d9c2"} Jul 02 16:57:25.676463 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.676446 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" event={"ID":"5e838d83-8c62-4634-b636-ac3ccd4991a1","Type":"ContainerStarted","Data":"2532dc3fcd18daee5bea29e8d408db897487df43bf8595a06694157a84cb9833"} Jul 02 16:57:25.677771 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.677752 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jl849" event={"ID":"c01ab504-69ff-450e-8e7f-2f2304fd1b0c","Type":"ContainerStarted","Data":"2f03cff2c41b3f6481c75a33922900e50162cf7fa4f8e66ee863fd33254d3e91"} Jul 02 16:57:25.679222 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.679202 2535 generic.go:356] "Generic (PLEG): container finished" podID="759b7e374782897a446d86b0b6a5b5ff" containerID="8842cfcf22cd1ec2940fd92957306431d4ea467ef618d4ca25c5ca966ed59c24" exitCode=0 Jul 02 16:57:25.679299 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.679260 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" event={"ID":"759b7e374782897a446d86b0b6a5b5ff","Type":"ContainerDied","Data":"8842cfcf22cd1ec2940fd92957306431d4ea467ef618d4ca25c5ca966ed59c24"} Jul 02 16:57:25.680515 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.680494 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kggjg" event={"ID":"fcf543f6-e108-478f-8250-0e809a1753b9","Type":"ContainerStarted","Data":"f411339fb4dda501ce26483e2c48102486cbf670bb2995b0ebe5a3220ac8b34b"} Jul 02 16:57:25.703986 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.703928 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-btkps" podStartSLOduration=3.462447083 podStartE2EDuration="23.703913775s" totalImagesPullingTime="20.241466692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:25.703858432 +0000 UTC m=+23.807876985" watchObservedRunningTime="2026-07-02 16:57:25.703913775 +0000 UTC m=+23.807932319" Jul 02 16:57:25.717273 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.717239 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kggjg" podStartSLOduration=3.48618276 podStartE2EDuration="23.717223803s" totalImagesPullingTime="20.231041043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:25.717131119 +0000 UTC m=+23.821149662" watchObservedRunningTime="2026-07-02 16:57:25.717223803 +0000 UTC m=+23.821242346" Jul 02 16:57:25.729969 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.729932 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jl849" podStartSLOduration=3.323723512 podStartE2EDuration="23.729920686s" totalImagesPullingTime="20.406197174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:25.729634459 +0000 UTC m=+23.833653004" watchObservedRunningTime="2026-07-02 16:57:25.729920686 +0000 UTC m=+23.833939229" Jul 02 16:57:25.759061 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.759025 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6s8q7" podStartSLOduration=3.509188067 podStartE2EDuration="23.75901306s" totalImagesPullingTime="20.249824993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:25.743382323 +0000 UTC m=+23.847400867" watchObservedRunningTime="2026-07-02 16:57:25.75901306 +0000 UTC m=+23.863031601" Jul 02 16:57:25.812931 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.812903 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:25.879585 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.879532 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:25.941363 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:25.941275 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:26.383618 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.383528 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:26.383771 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:26.383668 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:26.383771 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.383723 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:26.383874 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:26.383815 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:26.684502 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.684431 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" event={"ID":"759b7e374782897a446d86b0b6a5b5ff","Type":"ContainerStarted","Data":"eaece375d4ee7a21f50753424cc2c8929891e6e6b4ed8b809d110b291fdac753"} Jul 02 16:57:26.685855 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.685831 2535 generic.go:356] "Generic (PLEG): container finished" podID="a4b50285-ce97-4aa4-a352-13f8603f0ca6" containerID="e97bd30349769f80ea3c32602a493dac37ae3bf5652a16428f3dc793ebbf61fd" exitCode=0 Jul 02 16:57:26.685972 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.685902 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerDied","Data":"e97bd30349769f80ea3c32602a493dac37ae3bf5652a16428f3dc793ebbf61fd"} Jul 02 16:57:26.699626 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.699579 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" podStartSLOduration=23.699562839 podStartE2EDuration="23.699562839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:26.699531493 +0000 UTC m=+24.803550038" watchObservedRunningTime="2026-07-02 16:57:26.699562839 +0000 UTC m=+24.803581382" Jul 02 16:57:26.885654 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:26.885631 2535 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 16:57:27.371687 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.371511 2535 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T16:57:26.885648241Z","UUID":"673c7d23-acc9-47c8-b07b-ba83d04e5074","Handler":null,"Name":"","Endpoint":""} Jul 02 16:57:27.374021 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.373994 2535 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 16:57:27.374150 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.374052 2535 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 16:57:27.383443 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.383423 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:27.383575 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:27.383532 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:27.691059 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.690966 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" event={"ID":"5e838d83-8c62-4634-b636-ac3ccd4991a1","Type":"ContainerStarted","Data":"b3342225e27a801b3409e4595503ed19b1c24697e778e23ad81323fb06dba2ec"} Jul 02 16:57:27.694919 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.694897 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 16:57:27.695317 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:27.695276 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"9138a30e8012a7974101068a9c3fec48f65492495823082d49a093083c652cf3"} Jul 02 16:57:28.383814 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:28.383745 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:28.383974 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:28.383752 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:28.383974 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:28.383868 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:28.383974 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:28.383941 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:28.699112 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:28.699030 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" event={"ID":"5e838d83-8c62-4634-b636-ac3ccd4991a1","Type":"ContainerStarted","Data":"2394d493b5d8992f9b9b521bb0d72cb374c15bf52566c4d94a33082fcbe0c017"} Jul 02 16:57:29.348926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:29.346656 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:29.383751 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:29.383723 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:29.383882 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:29.383849 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:29.705156 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:29.705126 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 16:57:29.705797 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:29.705602 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"81c2b7dd6ffc22ec3777d1ec52b7847f6c1379cf361fb237df551e2bb943ab93"} Jul 02 16:57:29.706361 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:29.706337 2535 scope.go:117] "RemoveContainer" containerID="56cc708a5e71d8aa0380857c567cbbb0bc2bc8f1408cec65698ff96b235ddb7a" Jul 02 16:57:29.745689 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:29.745639 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wddcd" podStartSLOduration=5.032847334 podStartE2EDuration="27.745620518s" totalImagesPullingTime="22.712773184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:28.716247212 +0000 UTC m=+26.820265755" watchObservedRunningTime="2026-07-02 16:57:29.745620518 +0000 UTC m=+27.849639060" Jul 02 16:57:30.344579 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.344528 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:30.383524 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.383488 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:30.383524 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.383488 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:30.383743 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:30.383681 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:30.383743 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:30.383672 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:30.446056 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.445977 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:30.601515 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.601427 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:30.602092 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.602068 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:30.709062 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.709033 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:30.709678 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.709628 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-btkps" Jul 02 16:57:30.768684 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:30.768634 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:31.239750 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.239570 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4m766"] Jul 02 16:57:31.242148 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.240187 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:31.242148 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:31.240370 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:31.245566 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.245518 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tkrht"] Jul 02 16:57:31.245701 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.245685 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:31.245824 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:31.245800 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:31.246240 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.246223 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ls4jm"] Jul 02 16:57:31.246319 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.246300 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:31.246404 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:31.246383 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:31.714713 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.714686 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 16:57:31.715178 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.715052 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" event={"ID":"4f8cd8bd-cb03-43bf-8c17-01f69d1bb358","Type":"ContainerStarted","Data":"c1cb1106a8c94165eed843dfb63380279681671caf50da74330e287f7e132bb7"} Jul 02 16:57:31.715410 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.715371 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:31.715524 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.715439 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:31.715524 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.715486 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:31.717333 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.717188 2535 generic.go:356] "Generic (PLEG): container finished" podID="a4b50285-ce97-4aa4-a352-13f8603f0ca6" containerID="d2a2de99a02d0006f238ec2db74898d909b5777f915e726cd901e9e52f33ff6d" exitCode=0 Jul 02 16:57:31.717333 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.717240 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerDied","Data":"d2a2de99a02d0006f238ec2db74898d909b5777f915e726cd901e9e52f33ff6d"} Jul 02 16:57:31.728658 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.728610 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:31.731775 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.731757 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:31.731952 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.731937 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:57:31.796466 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.796413 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" podStartSLOduration=8.927848895 podStartE2EDuration="29.796396662s" totalImagesPullingTime="20.868547767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:31.759921169 +0000 UTC m=+29.863939711" watchObservedRunningTime="2026-07-02 16:57:31.796396662 +0000 UTC m=+29.900415184" Jul 02 16:57:31.846416 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.846394 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:31.958194 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:31.958166 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:32.069732 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:32.069656 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:32.226880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:32.226847 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:32.345592 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:32.345474 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:32.383796 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:32.383765 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:32.384045 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:32.383872 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:32.814448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:32.814409 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:32.943184 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:32.943156 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:33.261177 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:33.261143 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:33.383168 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:33.383139 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:33.383168 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:33.383158 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:33.383345 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:33.383234 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:33.383413 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:33.383367 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:33.392933 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:33.392906 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:33.724003 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:33.723968 2535 generic.go:356] "Generic (PLEG): container finished" podID="a4b50285-ce97-4aa4-a352-13f8603f0ca6" containerID="2272db44254144d2194309d03c5403bb162b35bf4aaa0f37c9896e86a02b993a" exitCode=0 Jul 02 16:57:33.724159 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:33.724049 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerDied","Data":"2272db44254144d2194309d03c5403bb162b35bf4aaa0f37c9896e86a02b993a"} Jul 02 16:57:34.383647 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:34.383618 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:34.384079 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:34.383722 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:35.028228 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.028198 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:35.028359 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.028239 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:35.028359 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.028264 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:35.028359 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028347 2535 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:35.028359 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028350 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:35.028492 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028396 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:57:35.028492 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028419 2535 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:57:35.028492 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028430 2535 projected.go:196] Error preparing data for projected volume kube-api-access-sxwx7 for pod openshift-network-diagnostics/network-check-target-tkrht: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:35.028492 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028402 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret podName:445acc05-aa49-4cc4-839a-c72e7016c4a3 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:07.028389844 +0000 UTC m=+65.132408364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret") pod "global-pull-secret-syncer-4m766" (UID: "445acc05-aa49-4cc4-839a-c72e7016c4a3") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:57:35.028492 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028487 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:07.028470824 +0000 UTC m=+65.132489355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:57:35.028670 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.028504 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7 podName:c5cdf4b8-97fb-4d02-8aff-b98a950b020a nodeName:}" failed. No retries permitted until 2026-07-02 16:58:07.028496909 +0000 UTC m=+65.132515429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxwx7" (UniqueName: "kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7") pod "network-check-target-tkrht" (UID: "c5cdf4b8-97fb-4d02-8aff-b98a950b020a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:57:35.383988 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.383956 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:35.384356 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.383956 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:35.384356 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.384056 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4m766" podUID="445acc05-aa49-4cc4-839a-c72e7016c4a3" Jul 02 16:57:35.384356 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:35.384169 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkrht" podUID="c5cdf4b8-97fb-4d02-8aff-b98a950b020a" Jul 02 16:57:35.729843 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.729811 2535 generic.go:356] "Generic (PLEG): container finished" podID="a4b50285-ce97-4aa4-a352-13f8603f0ca6" containerID="ed3158df1cb0100f4078f505717c8cdac3829d0cedd73646dcc99dbca964b23b" exitCode=0 Jul 02 16:57:35.730000 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:35.729868 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerDied","Data":"ed3158df1cb0100f4078f505717c8cdac3829d0cedd73646dcc99dbca964b23b"} Jul 02 16:57:36.384037 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:36.384007 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:36.384500 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:36.384151 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls4jm" podUID="8c4e6563-c355-4c14-acd4-b2b1b8981e11" Jul 02 16:57:37.218411 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.218386 2535 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeReady" Jul 02 16:57:37.218622 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.218554 2535 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 16:57:37.297032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.296964 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xnvlm"] Jul 02 16:57:37.314270 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.314234 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qbngg"] Jul 02 16:57:37.314419 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.314338 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.317433 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.317401 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 16:57:37.317433 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.317429 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 16:57:37.317640 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.317437 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gz8mr\"" Jul 02 16:57:37.336420 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.336393 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnvlm"] Jul 02 16:57:37.336565 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.336439 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbngg"] Jul 02 16:57:37.336565 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.336522 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.340573 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.340534 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 16:57:37.340696 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.340593 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p65nb\"" Jul 02 16:57:37.340891 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.340868 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 16:57:37.341114 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.341097 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 16:57:37.383395 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.383364 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:57:37.383550 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.383508 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:57:37.390226 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.390204 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:57:37.390995 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.390957 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:57:37.391436 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.391419 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwbzf\"" Jul 02 16:57:37.391519 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.391504 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:57:37.445080 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.445049 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.445248 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.445114 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/922c520e-3320-4d25-86be-f748bbcdd582-cert\") pod \"ingress-canary-qbngg\" (UID: \"922c520e-3320-4d25-86be-f748bbcdd582\") " pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.445248 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.445157 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rlp\" (UniqueName: \"kubernetes.io/projected/922c520e-3320-4d25-86be-f748bbcdd582-kube-api-access-s2rlp\") pod \"ingress-canary-qbngg\" (UID: \"922c520e-3320-4d25-86be-f748bbcdd582\") " pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.445248 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.445183 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e59d903-0e6e-45b4-81ac-22102ce05577-tmp-dir\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.445248 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.445217 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9f5x\" (UniqueName: \"kubernetes.io/projected/1e59d903-0e6e-45b4-81ac-22102ce05577-kube-api-access-x9f5x\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.445449 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.445265 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59d903-0e6e-45b4-81ac-22102ce05577-config-volume\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.521456 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.521418 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:37.546267 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546239 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59d903-0e6e-45b4-81ac-22102ce05577-config-volume\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.546432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546276 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.546432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546329 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/922c520e-3320-4d25-86be-f748bbcdd582-cert\") pod \"ingress-canary-qbngg\" (UID: \"922c520e-3320-4d25-86be-f748bbcdd582\") " pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.546432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546361 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rlp\" (UniqueName: \"kubernetes.io/projected/922c520e-3320-4d25-86be-f748bbcdd582-kube-api-access-s2rlp\") pod \"ingress-canary-qbngg\" (UID: \"922c520e-3320-4d25-86be-f748bbcdd582\") " pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.546432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546382 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e59d903-0e6e-45b4-81ac-22102ce05577-tmp-dir\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.546432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546405 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9f5x\" (UniqueName: \"kubernetes.io/projected/1e59d903-0e6e-45b4-81ac-22102ce05577-kube-api-access-x9f5x\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.546846 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:37.546818 2535 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:37.546955 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546849 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e59d903-0e6e-45b4-81ac-22102ce05577-tmp-dir\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.546955 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:37.546901 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls podName:1e59d903-0e6e-45b4-81ac-22102ce05577 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:38.046880768 +0000 UTC m=+36.150899294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls") pod "dns-default-xnvlm" (UID: "1e59d903-0e6e-45b4-81ac-22102ce05577") : secret "dns-default-metrics-tls" not found Jul 02 16:57:37.546955 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.546939 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1e59d903-0e6e-45b4-81ac-22102ce05577-config-volume\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.551039 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.550986 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/922c520e-3320-4d25-86be-f748bbcdd582-cert\") pod \"ingress-canary-qbngg\" (UID: \"922c520e-3320-4d25-86be-f748bbcdd582\") " pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.563417 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.563392 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rlp\" (UniqueName: \"kubernetes.io/projected/922c520e-3320-4d25-86be-f748bbcdd582-kube-api-access-s2rlp\") pod \"ingress-canary-qbngg\" (UID: \"922c520e-3320-4d25-86be-f748bbcdd582\") " pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.564381 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.564357 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9f5x\" (UniqueName: \"kubernetes.io/projected/1e59d903-0e6e-45b4-81ac-22102ce05577-kube-api-access-x9f5x\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:37.628255 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.628221 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:37.651092 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.651057 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbngg" Jul 02 16:57:37.816045 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:37.815961 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbngg"] Jul 02 16:57:37.822514 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:37.822330 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922c520e_3320_4d25_86be_f748bbcdd582.slice/crio-4a9a2808ad8a60bdf18ed212427cdb803d07a282eb83a3b4dcb6d0ffbb4b9e60 WatchSource:0}: Error finding container 4a9a2808ad8a60bdf18ed212427cdb803d07a282eb83a3b4dcb6d0ffbb4b9e60: Status 404 returned error can't find the container with id 4a9a2808ad8a60bdf18ed212427cdb803d07a282eb83a3b4dcb6d0ffbb4b9e60 Jul 02 16:57:38.051233 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:38.051199 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:38.051413 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:38.051311 2535 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:38.051413 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:38.051370 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls podName:1e59d903-0e6e-45b4-81ac-22102ce05577 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:39.051351266 +0000 UTC m=+37.155369805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls") pod "dns-default-xnvlm" (UID: "1e59d903-0e6e-45b4-81ac-22102ce05577") : secret "dns-default-metrics-tls" not found Jul 02 16:57:38.384116 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:38.384080 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:57:38.387935 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:38.387911 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzcqc\"" Jul 02 16:57:38.388120 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:38.387910 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:57:38.738954 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:38.738914 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbngg" event={"ID":"922c520e-3320-4d25-86be-f748bbcdd582","Type":"ContainerStarted","Data":"4a9a2808ad8a60bdf18ed212427cdb803d07a282eb83a3b4dcb6d0ffbb4b9e60"} Jul 02 16:57:39.057955 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:39.057867 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:39.058119 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:39.058039 2535 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:39.058182 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:39.058119 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls podName:1e59d903-0e6e-45b4-81ac-22102ce05577 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:41.058099868 +0000 UTC m=+39.162118389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls") pod "dns-default-xnvlm" (UID: "1e59d903-0e6e-45b4-81ac-22102ce05577") : secret "dns-default-metrics-tls" not found Jul 02 16:57:40.480642 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:40.480597 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:40.646498 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:40.646467 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:40.748727 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:40.748083 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerStarted","Data":"f56ee585e041b05f46181008aac64979c366bdabd54780b0205162cd6b155dc4"} Jul 02 16:57:40.750427 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:40.750395 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbngg" event={"ID":"922c520e-3320-4d25-86be-f748bbcdd582","Type":"ContainerStarted","Data":"f3d5fe9d69e1197b7a009e966cd4746f9d13451a11021edeccea2ef8f2ed6c87"} Jul 02 16:57:40.818432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:40.818375 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qbngg" podStartSLOduration=1.063396439 podStartE2EDuration="3.818353877s" totalImagesPullingTime="2.754957438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:40.818269549 +0000 UTC m=+38.922288091" watchObservedRunningTime="2026-07-02 16:57:40.818353877 +0000 UTC m=+38.922372421" Jul 02 16:57:41.072252 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:41.072163 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:41.072416 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:41.072331 2535 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:41.072416 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:41.072410 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls podName:1e59d903-0e6e-45b4-81ac-22102ce05577 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:45.072388871 +0000 UTC m=+43.176407404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls") pod "dns-default-xnvlm" (UID: "1e59d903-0e6e-45b4-81ac-22102ce05577") : secret "dns-default-metrics-tls" not found Jul 02 16:57:41.754597 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:41.754567 2535 generic.go:356] "Generic (PLEG): container finished" podID="a4b50285-ce97-4aa4-a352-13f8603f0ca6" containerID="f56ee585e041b05f46181008aac64979c366bdabd54780b0205162cd6b155dc4" exitCode=0 Jul 02 16:57:41.754956 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:41.754650 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerDied","Data":"f56ee585e041b05f46181008aac64979c366bdabd54780b0205162cd6b155dc4"} Jul 02 16:57:42.008855 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:42.008637 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:42.099755 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:42.099717 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:42.759557 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:42.759514 2535 generic.go:356] "Generic (PLEG): container finished" podID="a4b50285-ce97-4aa4-a352-13f8603f0ca6" containerID="1121ec9d999dfdb889e1dcd5a1903f172421e6b1b51034d0cb041c3f59ae29d5" exitCode=0 Jul 02 16:57:42.759893 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:42.759597 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerDied","Data":"1121ec9d999dfdb889e1dcd5a1903f172421e6b1b51034d0cb041c3f59ae29d5"} Jul 02 16:57:43.765783 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:43.765751 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" event={"ID":"a4b50285-ce97-4aa4-a352-13f8603f0ca6","Type":"ContainerStarted","Data":"6b50b2d46747f87f833cd833acca815ccfc818ad07824ad36bced70b8c3a0233"} Jul 02 16:57:43.802055 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:43.802011 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7xsbc" podStartSLOduration=10.154088229 podStartE2EDuration="41.801997924s" totalImagesPullingTime="31.647909695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:43.799429954 +0000 UTC m=+41.903448519" watchObservedRunningTime="2026-07-02 16:57:43.801997924 +0000 UTC m=+41.906016465" Jul 02 16:57:43.968791 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:43.968752 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:44.075267 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:44.075187 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:44.181908 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:44.181864 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:45.099818 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:45.099777 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:45.100283 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:45.099946 2535 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:45.100283 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:45.100025 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls podName:1e59d903-0e6e-45b4-81ac-22102ce05577 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:53.100003985 +0000 UTC m=+51.204022507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls") pod "dns-default-xnvlm" (UID: "1e59d903-0e6e-45b4-81ac-22102ce05577") : secret "dns-default-metrics-tls" not found Jul 02 16:57:48.281811 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.281780 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6"] Jul 02 16:57:48.325003 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.324972 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq"] Jul 02 16:57:48.325132 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.325089 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.331099 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.331070 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 16:57:48.332334 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.332310 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 16:57:48.332697 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.332678 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 16:57:48.334299 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.334269 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 16:57:48.334393 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.334286 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t8v7f\"" Jul 02 16:57:48.342705 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.342685 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq"] Jul 02 16:57:48.342705 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.342716 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6"] Jul 02 16:57:48.342835 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.342791 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" Jul 02 16:57:48.355724 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.355699 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:48.355826 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.355733 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:48.355826 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.355811 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7xjr6\"" Jul 02 16:57:48.399827 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.399804 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z"] Jul 02 16:57:48.420390 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.420362 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c8d968c5f-mk6qb"] Jul 02 16:57:48.420583 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.420564 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.422444 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422425 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.422529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422468 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75207b6c-e7bf-44b4-908c-403cd6a5dac3-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.422529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422501 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.422659 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422531 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxmxn\" (UniqueName: \"kubernetes.io/projected/9140028d-8a7f-4679-9b70-3f11f2251048-kube-api-access-kxmxn\") pod \"volume-data-source-validator-69d9f679db-nvjkq\" (UID: \"9140028d-8a7f-4679-9b70-3f11f2251048\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" Jul 02 16:57:48.422659 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422588 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.422659 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422630 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4zj\" (UniqueName: \"kubernetes.io/projected/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-kube-api-access-vj4zj\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.422805 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.422675 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khgm\" (UniqueName: \"kubernetes.io/projected/75207b6c-e7bf-44b4-908c-403cd6a5dac3-kube-api-access-5khgm\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.424434 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.424416 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 16:57:48.439364 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.439348 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:48.439460 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.439440 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 16:57:48.439583 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.439566 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:48.439867 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.439853 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hbnsw\"" Jul 02 16:57:48.446568 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.446533 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z"] Jul 02 16:57:48.446631 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.446580 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7l8jd"] Jul 02 16:57:48.446631 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.446616 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.452715 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.452668 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 16:57:48.453132 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.453018 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rx47j\"" Jul 02 16:57:48.453403 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.453386 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 16:57:48.453820 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.453806 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 16:57:48.454189 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.454176 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 16:57:48.454658 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.454646 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 16:57:48.454827 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.454816 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 16:57:48.470631 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.470609 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c8d968c5f-mk6qb"] Jul 02 16:57:48.470708 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.470689 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.476579 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.476561 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:57:48.476684 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.476623 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 16:57:48.477046 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.477027 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x6fr5\"" Jul 02 16:57:48.477122 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.477081 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 16:57:48.477734 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.477718 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 16:57:48.477962 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.477945 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7l8jd"] Jul 02 16:57:48.492872 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.492852 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 16:57:48.523512 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523490 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4zj\" (UniqueName: \"kubernetes.io/projected/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-kube-api-access-vj4zj\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.523620 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523515 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khgm\" (UniqueName: \"kubernetes.io/projected/75207b6c-e7bf-44b4-908c-403cd6a5dac3-kube-api-access-5khgm\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.523620 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523566 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-trusted-ca\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.523620 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523605 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.523755 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523622 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.523755 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523646 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.523897 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523766 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnp5f\" (UniqueName: \"kubernetes.io/projected/f9c3da69-4e81-4847-96b1-9d04e2a823bd-kube-api-access-dnp5f\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.523897 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523801 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-config\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.523897 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523846 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75207b6c-e7bf-44b4-908c-403cd6a5dac3-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.523897 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523868 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.523897 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523894 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-serving-cert\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.524143 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523924 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg99m\" (UniqueName: \"kubernetes.io/projected/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-kube-api-access-dg99m\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.524143 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523954 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmxn\" (UniqueName: \"kubernetes.io/projected/9140028d-8a7f-4679-9b70-3f11f2251048-kube-api-access-kxmxn\") pod \"volume-data-source-validator-69d9f679db-nvjkq\" (UID: \"9140028d-8a7f-4679-9b70-3f11f2251048\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" Jul 02 16:57:48.524143 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.523982 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-default-certificate\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.524143 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.524020 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.524143 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.524046 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-stats-auth\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.524143 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.524125 2535 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:48.524415 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.524191 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls podName:75207b6c-e7bf-44b4-908c-403cd6a5dac3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:49.024172295 +0000 UTC m=+47.128190824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhzt6" (UID: "75207b6c-e7bf-44b4-908c-403cd6a5dac3") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:48.524415 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.524321 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.524503 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.524486 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75207b6c-e7bf-44b4-908c-403cd6a5dac3-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.527811 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.527796 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.543809 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.543758 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dd7cb7b8-46s7l"] Jul 02 16:57:48.560487 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.560455 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khgm\" (UniqueName: \"kubernetes.io/projected/75207b6c-e7bf-44b4-908c-403cd6a5dac3-kube-api-access-5khgm\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:48.561407 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.561387 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4zj\" (UniqueName: \"kubernetes.io/projected/42a88e60-14d8-491d-9d1d-e71c8ebe02fe-kube-api-access-vj4zj\") pod \"kube-storage-version-migrator-operator-79964ff6f9-gpf2z\" (UID: \"42a88e60-14d8-491d-9d1d-e71c8ebe02fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.562765 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.562748 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.565321 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.565298 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxmxn\" (UniqueName: \"kubernetes.io/projected/9140028d-8a7f-4679-9b70-3f11f2251048-kube-api-access-kxmxn\") pod \"volume-data-source-validator-69d9f679db-nvjkq\" (UID: \"9140028d-8a7f-4679-9b70-3f11f2251048\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" Jul 02 16:57:48.566046 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.566031 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 16:57:48.567215 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.567201 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 16:57:48.567604 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.567583 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 16:57:48.567762 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.567747 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lw9nb\"" Jul 02 16:57:48.577486 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.577465 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 16:57:48.583946 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.583925 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd7cb7b8-46s7l"] Jul 02 16:57:48.624411 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624390 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-trusted-ca\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.624513 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624422 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-trusted-ca\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.624513 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624450 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.624513 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624473 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg99m\" (UniqueName: \"kubernetes.io/projected/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-kube-api-access-dg99m\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.624513 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624503 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/514e38cf-c6d4-4a96-9111-304fed89e0f6-ca-trust-extracted\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.624703 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624527 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnp5f\" (UniqueName: \"kubernetes.io/projected/f9c3da69-4e81-4847-96b1-9d04e2a823bd-kube-api-access-dnp5f\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.624703 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624570 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-config\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.624703 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624610 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-installation-pull-secrets\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.624863 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624727 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-serving-cert\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.624863 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.624756 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:49.124740334 +0000 UTC m=+47.228758857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : configmap references non-existent config key: service-ca.crt Jul 02 16:57:48.624863 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624799 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-certificates\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.624863 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624840 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-stats-auth\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.625053 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624883 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-bound-sa-token\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.625053 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624954 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.625053 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.624998 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-image-registry-private-configuration\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.625053 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.625031 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.625246 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.625062 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-default-certificate\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.625246 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.625083 2535 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:57:48.625246 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.625106 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96z5k\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-kube-api-access-96z5k\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.625246 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.625134 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:49.12511734 +0000 UTC m=+47.229135880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : secret "router-metrics-certs-default" not found Jul 02 16:57:48.625440 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.625306 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-config\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.625440 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.625333 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-trusted-ca\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.626920 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.626903 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-serving-cert\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.627148 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.627133 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-stats-auth\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.627261 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.627245 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-default-certificate\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.650796 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.650776 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" Jul 02 16:57:48.659895 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.659871 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnp5f\" (UniqueName: \"kubernetes.io/projected/f9c3da69-4e81-4847-96b1-9d04e2a823bd-kube-api-access-dnp5f\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:48.660623 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.660607 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg99m\" (UniqueName: \"kubernetes.io/projected/bf7fe272-a14c-42aa-af6c-d9812fcc2e34-kube-api-access-dg99m\") pod \"console-operator-7fdbdf9c99-7l8jd\" (UID: \"bf7fe272-a14c-42aa-af6c-d9812fcc2e34\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.725943 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.725917 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-installation-pull-secrets\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726076 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.725952 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-certificates\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726191 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726163 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-bound-sa-token\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726290 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726257 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-image-registry-private-configuration\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726356 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726296 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726356 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726340 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96z5k\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-kube-api-access-96z5k\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726442 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726368 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-trusted-ca\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726442 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726421 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/514e38cf-c6d4-4a96-9111-304fed89e0f6-ca-trust-extracted\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726521 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.726459 2535 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:57:48.726521 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.726479 2535 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd7cb7b8-46s7l: secret "image-registry-tls" not found Jul 02 16:57:48.726521 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726487 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-certificates\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.726680 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:48.726555 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls podName:514e38cf-c6d4-4a96-9111-304fed89e0f6 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:49.226518717 +0000 UTC m=+47.330537240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls") pod "image-registry-6dd7cb7b8-46s7l" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6") : secret "image-registry-tls" not found Jul 02 16:57:48.726850 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.726827 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/514e38cf-c6d4-4a96-9111-304fed89e0f6-ca-trust-extracted\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.727602 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.727563 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-trusted-ca\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.729043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.729009 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-image-registry-private-configuration\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.729243 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.729223 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-installation-pull-secrets\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.730060 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.730043 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" Jul 02 16:57:48.754064 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.754040 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-bound-sa-token\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.756120 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.756044 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96z5k\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-kube-api-access-96z5k\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:48.780176 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.780151 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:48.811455 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.810385 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq"] Jul 02 16:57:48.826474 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:48.826449 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9140028d_8a7f_4679_9b70_3f11f2251048.slice/crio-9f40cd4f3d7160eec1e647aea88828a2bd287bbadd6117b5241b99796d817de8 WatchSource:0}: Error finding container 9f40cd4f3d7160eec1e647aea88828a2bd287bbadd6117b5241b99796d817de8: Status 404 returned error can't find the container with id 9f40cd4f3d7160eec1e647aea88828a2bd287bbadd6117b5241b99796d817de8 Jul 02 16:57:48.877157 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.877060 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:48.896260 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.896219 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z"] Jul 02 16:57:48.902496 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:48.902450 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a88e60_14d8_491d_9d1d_e71c8ebe02fe.slice/crio-5a7a7b18003e74f06d68e20ac9b7b71dad11df1cabca6abb35c2efc2d9391577 WatchSource:0}: Error finding container 5a7a7b18003e74f06d68e20ac9b7b71dad11df1cabca6abb35c2efc2d9391577: Status 404 returned error can't find the container with id 5a7a7b18003e74f06d68e20ac9b7b71dad11df1cabca6abb35c2efc2d9391577 Jul 02 16:57:48.957201 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:48.957167 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7l8jd"] Jul 02 16:57:48.959869 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:48.959841 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7fe272_a14c_42aa_af6c_d9812fcc2e34.slice/crio-3858a6102fad1a0bf00e9d1b3560641da58a9abc1e7e82d08526ba692a6f8a26 WatchSource:0}: Error finding container 3858a6102fad1a0bf00e9d1b3560641da58a9abc1e7e82d08526ba692a6f8a26: Status 404 returned error can't find the container with id 3858a6102fad1a0bf00e9d1b3560641da58a9abc1e7e82d08526ba692a6f8a26 Jul 02 16:57:49.007092 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.007062 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:49.029025 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.029001 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:49.029154 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.029139 2535 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:49.029206 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.029194 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls podName:75207b6c-e7bf-44b4-908c-403cd6a5dac3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:50.029181323 +0000 UTC m=+48.133199844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhzt6" (UID: "75207b6c-e7bf-44b4-908c-403cd6a5dac3") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:49.130187 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.130106 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:49.130187 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.130190 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:49.130382 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.130316 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:50.130294704 +0000 UTC m=+48.234313237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : configmap references non-existent config key: service-ca.crt Jul 02 16:57:49.130382 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.130327 2535 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:57:49.130382 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.130366 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:50.130355598 +0000 UTC m=+48.234374118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : secret "router-metrics-certs-default" not found Jul 02 16:57:49.231372 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.231339 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:49.231517 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.231486 2535 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:57:49.231517 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.231505 2535 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd7cb7b8-46s7l: secret "image-registry-tls" not found Jul 02 16:57:49.231609 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:49.231574 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls podName:514e38cf-c6d4-4a96-9111-304fed89e0f6 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:50.231558162 +0000 UTC m=+48.335576688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls") pod "image-registry-6dd7cb7b8-46s7l" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6") : secret "image-registry-tls" not found Jul 02 16:57:49.780955 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.780909 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" event={"ID":"9140028d-8a7f-4679-9b70-3f11f2251048","Type":"ContainerStarted","Data":"9f40cd4f3d7160eec1e647aea88828a2bd287bbadd6117b5241b99796d817de8"} Jul 02 16:57:49.782455 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.782424 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" event={"ID":"42a88e60-14d8-491d-9d1d-e71c8ebe02fe","Type":"ContainerStarted","Data":"5a7a7b18003e74f06d68e20ac9b7b71dad11df1cabca6abb35c2efc2d9391577"} Jul 02 16:57:49.783818 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:49.783766 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" event={"ID":"bf7fe272-a14c-42aa-af6c-d9812fcc2e34","Type":"ContainerStarted","Data":"3858a6102fad1a0bf00e9d1b3560641da58a9abc1e7e82d08526ba692a6f8a26"} Jul 02 16:57:50.038777 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.038692 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:50.038944 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.038808 2535 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:50.038944 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.038880 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls podName:75207b6c-e7bf-44b4-908c-403cd6a5dac3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:52.038860402 +0000 UTC m=+50.142878933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhzt6" (UID: "75207b6c-e7bf-44b4-908c-403cd6a5dac3") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:50.139901 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.139869 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:50.140031 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.139949 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:50.140083 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.140026 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:52.140010274 +0000 UTC m=+50.244028794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : configmap references non-existent config key: service-ca.crt Jul 02 16:57:50.140083 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.140050 2535 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:57:50.140160 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.140087 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:52.140076639 +0000 UTC m=+50.244095159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : secret "router-metrics-certs-default" not found Jul 02 16:57:50.241150 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.241106 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:50.241372 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.241230 2535 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:57:50.241372 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.241247 2535 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd7cb7b8-46s7l: secret "image-registry-tls" not found Jul 02 16:57:50.241372 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:50.241305 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls podName:514e38cf-c6d4-4a96-9111-304fed89e0f6 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:52.24128886 +0000 UTC m=+50.345307381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls") pod "image-registry-6dd7cb7b8-46s7l" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6") : secret "image-registry-tls" not found Jul 02 16:57:50.788088 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.788042 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" event={"ID":"9140028d-8a7f-4679-9b70-3f11f2251048","Type":"ContainerStarted","Data":"c3e5f20beb4476ec28e261a960de3dc1793f3cfad8dbd6762c23f0ee6af4f7a7"} Jul 02 16:57:50.810075 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.810014 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nvjkq" podStartSLOduration=1.234516606 podStartE2EDuration="2.809999453s" totalImagesPullingTime="1.575482847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:50.809231836 +0000 UTC m=+48.913250379" watchObservedRunningTime="2026-07-02 16:57:50.809999453 +0000 UTC m=+48.914017997" Jul 02 16:57:50.982043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:50.981982 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:51.083666 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:51.083575 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:52.057226 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.057184 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:52.057618 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.057330 2535 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:52.057618 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.057404 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls podName:75207b6c-e7bf-44b4-908c-403cd6a5dac3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:56.057384369 +0000 UTC m=+54.161402888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhzt6" (UID: "75207b6c-e7bf-44b4-908c-403cd6a5dac3") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:52.157804 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.157778 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:52.157906 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.157865 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:52.157960 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.157940 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:56.157921268 +0000 UTC m=+54.261939787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : configmap references non-existent config key: service-ca.crt Jul 02 16:57:52.158018 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.157968 2535 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:57:52.158018 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.158006 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:57:56.157995696 +0000 UTC m=+54.262014217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : secret "router-metrics-certs-default" not found Jul 02 16:57:52.259113 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.259034 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:52.259255 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.259157 2535 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:57:52.259255 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.259167 2535 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd7cb7b8-46s7l: secret "image-registry-tls" not found Jul 02 16:57:52.259255 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:52.259215 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls podName:514e38cf-c6d4-4a96-9111-304fed89e0f6 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:56.259203098 +0000 UTC m=+54.363221617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls") pod "image-registry-6dd7cb7b8-46s7l" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6") : secret "image-registry-tls" not found Jul 02 16:57:52.550639 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.550532 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:52.707484 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.707440 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:52.793712 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.793670 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" event={"ID":"42a88e60-14d8-491d-9d1d-e71c8ebe02fe","Type":"ContainerStarted","Data":"ab249ad8aefbdcbe22860858dd4de6f43cd9f076891f43a3c1518a7456153bd0"} Jul 02 16:57:52.795290 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.795268 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/0.log" Jul 02 16:57:52.795423 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.795304 2535 generic.go:356] "Generic (PLEG): container finished" podID="bf7fe272-a14c-42aa-af6c-d9812fcc2e34" containerID="f34caf16a995cb3230e311dca397984bea8671397c8d970c38244a8869d374e9" exitCode=255 Jul 02 16:57:52.795423 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.795330 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" event={"ID":"bf7fe272-a14c-42aa-af6c-d9812fcc2e34","Type":"ContainerDied","Data":"f34caf16a995cb3230e311dca397984bea8671397c8d970c38244a8869d374e9"} Jul 02 16:57:52.795575 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.795531 2535 scope.go:117] "RemoveContainer" containerID="f34caf16a995cb3230e311dca397984bea8671397c8d970c38244a8869d374e9" Jul 02 16:57:52.832255 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:52.832217 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" podStartSLOduration=1.746299364 podStartE2EDuration="4.832204452s" totalImagesPullingTime="3.085905088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:52.831926458 +0000 UTC m=+50.935945004" watchObservedRunningTime="2026-07-02 16:57:52.832204452 +0000 UTC m=+50.936222971" Jul 02 16:57:53.018469 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.018430 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:53.153843 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.153766 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:53.167879 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.167854 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:57:53.168007 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:53.167990 2535 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:57:53.168060 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:53.168051 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls podName:1e59d903-0e6e-45b4-81ac-22102ce05577 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:09.168035565 +0000 UTC m=+67.272054086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls") pod "dns-default-xnvlm" (UID: "1e59d903-0e6e-45b4-81ac-22102ce05577") : secret "dns-default-metrics-tls" not found Jul 02 16:57:53.519124 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.519084 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:53.777443 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.777368 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:53.801027 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.801004 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 16:57:53.801387 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.801371 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/0.log" Jul 02 16:57:53.801454 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.801405 2535 generic.go:356] "Generic (PLEG): container finished" podID="bf7fe272-a14c-42aa-af6c-d9812fcc2e34" containerID="1400f57aac8101ae87ba0189308f555352c7cddcb59f2ee95053b25484d6b15b" exitCode=255 Jul 02 16:57:53.801509 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.801486 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" event={"ID":"bf7fe272-a14c-42aa-af6c-d9812fcc2e34","Type":"ContainerDied","Data":"1400f57aac8101ae87ba0189308f555352c7cddcb59f2ee95053b25484d6b15b"} Jul 02 16:57:53.801576 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.801564 2535 scope.go:117] "RemoveContainer" containerID="f34caf16a995cb3230e311dca397984bea8671397c8d970c38244a8869d374e9" Jul 02 16:57:53.801853 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.801831 2535 scope.go:117] "RemoveContainer" containerID="1400f57aac8101ae87ba0189308f555352c7cddcb59f2ee95053b25484d6b15b" Jul 02 16:57:53.802023 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:53.802002 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7l8jd_openshift-console-operator(bf7fe272-a14c-42aa-af6c-d9812fcc2e34)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" podUID="bf7fe272-a14c-42aa-af6c-d9812fcc2e34" Jul 02 16:57:53.955846 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:53.955801 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:54.140289 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.140212 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:54.301891 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.301837 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:54.469355 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.469327 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c4s5p"] Jul 02 16:57:54.489923 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.489895 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.492802 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.492772 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 16:57:54.493318 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.493299 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 16:57:54.493766 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.493749 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 16:57:54.493843 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.493748 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 16:57:54.493843 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.493754 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4pq6p\"" Jul 02 16:57:54.506426 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.506398 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c4s5p"] Jul 02 16:57:54.531307 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.531279 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:54.580494 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.580457 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-data-volume\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.580675 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.580588 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.580675 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.580632 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.580675 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.580666 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8zb9\" (UniqueName: \"kubernetes.io/projected/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-api-access-f8zb9\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.580813 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.580688 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-crio-socket\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.667014 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.666977 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:54.681964 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.681937 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.682077 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.681987 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.682077 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.682032 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8zb9\" (UniqueName: \"kubernetes.io/projected/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-api-access-f8zb9\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.682077 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.682068 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-crio-socket\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.682221 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:54.682089 2535 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:57:54.682221 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:54.682146 2535 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:57:54.682221 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:54.682152 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:55.182133456 +0000 UTC m=+53.286151978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : configmap "kube-rbac-proxy" not found Jul 02 16:57:54.682358 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.682226 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-data-volume\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.682358 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:54.682257 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:55.182233661 +0000 UTC m=+53.286252190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : secret "insights-runtime-extractor-tls" not found Jul 02 16:57:54.682358 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.682331 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-crio-socket\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.682523 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.682505 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-data-volume\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.696109 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.696084 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8zb9\" (UniqueName: \"kubernetes.io/projected/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-api-access-f8zb9\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:54.805086 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.805017 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 16:57:54.805333 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.805318 2535 scope.go:117] "RemoveContainer" containerID="1400f57aac8101ae87ba0189308f555352c7cddcb59f2ee95053b25484d6b15b" Jul 02 16:57:54.805473 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:54.805456 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7l8jd_openshift-console-operator(bf7fe272-a14c-42aa-af6c-d9812fcc2e34)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" podUID="bf7fe272-a14c-42aa-af6c-d9812fcc2e34" Jul 02 16:57:54.975896 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:54.975854 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:55.186709 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:55.186625 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:55.186709 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:55.186666 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:55.186935 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:55.186764 2535 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:57:55.186935 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:55.186840 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:56.186818816 +0000 UTC m=+54.290837353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : configmap "kube-rbac-proxy" not found Jul 02 16:57:55.186935 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:55.186772 2535 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:57:55.186935 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:55.186900 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:56.186888151 +0000 UTC m=+54.290906670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : secret "insights-runtime-extractor-tls" not found Jul 02 16:57:55.491557 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:55.491517 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:55.671081 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:55.671046 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:55.790144 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:55.790055 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:56.093217 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.093113 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:57:56.093387 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.093274 2535 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:56.093387 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.093340 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls podName:75207b6c-e7bf-44b4-908c-403cd6a5dac3 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.093324706 +0000 UTC m=+62.197343231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhzt6" (UID: "75207b6c-e7bf-44b4-908c-403cd6a5dac3") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:57:56.194139 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.194104 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:56.194296 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.194150 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:56.194296 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.194216 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:56.194296 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194222 2535 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:57:56.194296 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194285 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:58.194266435 +0000 UTC m=+56.298284978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : configmap "kube-rbac-proxy" not found Jul 02 16:57:56.194432 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194304 2535 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:57:56.194432 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194307 2535 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:57:56.194432 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194337 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.194326683 +0000 UTC m=+62.298345204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : secret "router-metrics-certs-default" not found Jul 02 16:57:56.194432 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194362 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:58.194350512 +0000 UTC m=+56.298369033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : secret "insights-runtime-extractor-tls" not found Jul 02 16:57:56.194432 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.194416 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:57:56.194761 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.194512 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.194503258 +0000 UTC m=+62.298521777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : configmap references non-existent config key: service-ca.crt Jul 02 16:57:56.295403 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.295369 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:57:56.295559 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.295493 2535 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:57:56.295559 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.295504 2535 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd7cb7b8-46s7l: secret "image-registry-tls" not found Jul 02 16:57:56.295664 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:56.295567 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls podName:514e38cf-c6d4-4a96-9111-304fed89e0f6 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:04.295554943 +0000 UTC m=+62.399573476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls") pod "image-registry-6dd7cb7b8-46s7l" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6") : secret "image-registry-tls" not found Jul 02 16:57:56.413721 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.413644 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:56.561374 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.561337 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:56.578917 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:56.578896 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6s8q7_4aaf5b2d-da3d-47e4-beb8-918c342285a0/dns-node-resolver/0.log" Jul 02 16:57:57.628697 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.628660 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-lx45v"] Jul 02 16:57:57.631445 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.631425 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.635294 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.635275 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 16:57:57.635993 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.635974 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hkcmc\"" Jul 02 16:57:57.636068 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.636041 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 16:57:57.636068 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.636054 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 16:57:57.636142 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.636081 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 16:57:57.663307 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.663285 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-lx45v"] Jul 02 16:57:57.709018 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.708980 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-signing-key\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.709175 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.709071 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg9vl\" (UniqueName: \"kubernetes.io/projected/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-kube-api-access-fg9vl\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.709175 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.709118 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.782809 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.782778 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kggjg_fcf543f6-e108-478f-8250-0e809a1753b9/node-ca/0.log" Jul 02 16:57:57.810515 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.810483 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.810686 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.810579 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-signing-key\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.810686 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.810644 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg9vl\" (UniqueName: \"kubernetes.io/projected/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-kube-api-access-fg9vl\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.811188 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.811161 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.813018 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.812998 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-signing-key\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.826886 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.826861 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg9vl\" (UniqueName: \"kubernetes.io/projected/be1e1c5a-58d0-4ae9-93c1-abf7af3363d2-kube-api-access-fg9vl\") pod \"service-ca-7bb4f4bcc7-lx45v\" (UID: \"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.940442 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.940371 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" Jul 02 16:57:57.959086 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:57.959058 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:58.078061 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.078031 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:58.083435 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.083409 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-lx45v"] Jul 02 16:57:58.086844 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:57:58.086812 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1e1c5a_58d0_4ae9_93c1_abf7af3363d2.slice/crio-66d7c9c3c49ebc3a9f7cbed9f76788b544f19fa26e817bfab90eb6ac7d81e1ad WatchSource:0}: Error finding container 66d7c9c3c49ebc3a9f7cbed9f76788b544f19fa26e817bfab90eb6ac7d81e1ad: Status 404 returned error can't find the container with id 66d7c9c3c49ebc3a9f7cbed9f76788b544f19fa26e817bfab90eb6ac7d81e1ad Jul 02 16:57:58.214558 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.214498 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:58.214710 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.214569 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:57:58.214710 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:58.214618 2535 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:57:58.214710 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:58.214687 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:02.214668217 +0000 UTC m=+60.318686756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : configmap "kube-rbac-proxy" not found Jul 02 16:57:58.214815 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:58.214710 2535 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:57:58.214815 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:58.214750 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:02.214738702 +0000 UTC m=+60.318757240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : secret "insights-runtime-extractor-tls" not found Jul 02 16:57:58.381824 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.381794 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qbngg_922c520e-3320-4d25-86be-f748bbcdd582/serve-healthcheck-canary/0.log" Jul 02 16:57:58.780802 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.780749 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:58.781211 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.780829 2535 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:57:58.781211 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.781175 2535 scope.go:117] "RemoveContainer" containerID="1400f57aac8101ae87ba0189308f555352c7cddcb59f2ee95053b25484d6b15b" Jul 02 16:57:58.781401 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:57:58.781377 2535 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7l8jd_openshift-console-operator(bf7fe272-a14c-42aa-af6c-d9812fcc2e34)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" podUID="bf7fe272-a14c-42aa-af6c-d9812fcc2e34" Jul 02 16:57:58.816653 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.816598 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" event={"ID":"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2","Type":"ContainerStarted","Data":"66d7c9c3c49ebc3a9f7cbed9f76788b544f19fa26e817bfab90eb6ac7d81e1ad"} Jul 02 16:57:58.998123 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:58.998084 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:59.103207 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:59.103113 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:57:59.175050 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:57:59.174980 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-gpf2z_42a88e60-14d8-491d-9d1d-e71c8ebe02fe/kube-storage-version-migrator-operator/0.log" Jul 02 16:58:00.824275 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:00.824242 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" event={"ID":"be1e1c5a-58d0-4ae9-93c1-abf7af3363d2","Type":"ContainerStarted","Data":"1fbd50b0e7f93802ce15f511c998f8dbbe38b03632d9c5f66b2b8ceaa2cf719b"} Jul 02 16:58:01.374691 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:01.374644 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:01.519781 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:01.519750 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:01.672999 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:01.672864 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:01.797727 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:01.797690 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:02.064062 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:02.064032 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:02.252761 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:02.252732 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:02.252929 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:02.252769 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:02.252929 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:02.252868 2535 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:58:02.252929 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:02.252869 2535 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:58:02.252929 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:02.252916 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:10.252902861 +0000 UTC m=+68.356921381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : secret "insights-runtime-extractor-tls" not found Jul 02 16:58:02.252929 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:02.252930 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:10.252923378 +0000 UTC m=+68.356941897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : configmap "kube-rbac-proxy" not found Jul 02 16:58:03.092383 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:03.092345 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:03.453897 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:03.453861 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:03.698424 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:03.698393 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:03.734947 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:03.734876 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn8gx" Jul 02 16:58:03.778943 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:03.778894 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-lx45v" podStartSLOduration=4.731681042 podStartE2EDuration="6.778877949s" totalImagesPullingTime="2.047196907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:00.85116623 +0000 UTC m=+58.955184773" watchObservedRunningTime="2026-07-02 16:58:03.778877949 +0000 UTC m=+61.882896493" Jul 02 16:58:03.873086 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:03.873046 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:04.169411 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:04.169325 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:58:04.169812 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.169446 2535 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 16:58:04.169812 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.169504 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls podName:75207b6c-e7bf-44b4-908c-403cd6a5dac3 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:20.169487398 +0000 UTC m=+78.273505924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhzt6" (UID: "75207b6c-e7bf-44b4-908c-403cd6a5dac3") : secret "cluster-monitoring-operator-tls" not found Jul 02 16:58:04.261192 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:04.261152 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:04.270140 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:04.270113 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:04.270267 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:04.270251 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:04.270330 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.270293 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:58:20.270273431 +0000 UTC m=+78.374291972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : configmap references non-existent config key: service-ca.crt Jul 02 16:58:04.270394 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.270339 2535 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 16:58:04.270445 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.270396 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs podName:f9c3da69-4e81-4847-96b1-9d04e2a823bd nodeName:}" failed. No retries permitted until 2026-07-02 16:58:20.270384069 +0000 UTC m=+78.374402591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs") pod "router-default-c8d968c5f-mk6qb" (UID: "f9c3da69-4e81-4847-96b1-9d04e2a823bd") : secret "router-metrics-certs-default" not found Jul 02 16:58:04.371686 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:04.371645 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:04.371889 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.371804 2535 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 16:58:04.371889 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.371825 2535 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dd7cb7b8-46s7l: secret "image-registry-tls" not found Jul 02 16:58:04.371889 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:04.371885 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls podName:514e38cf-c6d4-4a96-9111-304fed89e0f6 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:20.371868699 +0000 UTC m=+78.475887238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls") pod "image-registry-6dd7cb7b8-46s7l" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6") : secret "image-registry-tls" not found Jul 02 16:58:04.852840 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:04.852802 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:05.044785 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:05.044750 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:05.227047 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:05.227022 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:05.483360 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:05.483277 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:05.671046 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:05.670998 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:06.051427 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:06.051386 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:06.170628 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:06.170589 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:06.319207 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:06.319123 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:06.517322 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:06.517286 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:06.683689 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:06.683605 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:07.095313 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.095270 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:58:07.095525 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.095418 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:58:07.095525 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.095447 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:58:07.103049 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.103024 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:58:07.103986 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.103967 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:58:07.104242 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.104227 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:58:07.106308 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:07.106292 2535 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 16:58:07.106375 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:07.106359 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs podName:8c4e6563-c355-4c14-acd4-b2b1b8981e11 nodeName:}" failed. No retries permitted until 2026-07-02 16:59:11.106337274 +0000 UTC m=+129.210355814 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs") pod "network-metrics-daemon-ls4jm" (UID: "8c4e6563-c355-4c14-acd4-b2b1b8981e11") : secret "metrics-daemon-secret" not found Jul 02 16:58:07.108313 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.108298 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:58:07.108562 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.108528 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/445acc05-aa49-4cc4-839a-c72e7016c4a3-original-pull-secret\") pod \"global-pull-secret-syncer-4m766\" (UID: \"445acc05-aa49-4cc4-839a-c72e7016c4a3\") " pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:58:07.119294 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.119274 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwx7\" (UniqueName: \"kubernetes.io/projected/c5cdf4b8-97fb-4d02-8aff-b98a950b020a-kube-api-access-sxwx7\") pod \"network-check-target-tkrht\" (UID: \"c5cdf4b8-97fb-4d02-8aff-b98a950b020a\") " pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:58:07.395242 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.395174 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4m766" Jul 02 16:58:07.403612 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.403590 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwbzf\"" Jul 02 16:58:07.411587 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.411563 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:58:07.487013 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.486861 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:07.561509 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.561478 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4m766"] Jul 02 16:58:07.563749 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.563729 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tkrht"] Jul 02 16:58:07.565534 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:07.565496 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445acc05_aa49_4cc4_839a_c72e7016c4a3.slice/crio-ddf11b3477a5b9657ca4c5b84f308d871cff635930c868e855de2ce0838144af WatchSource:0}: Error finding container ddf11b3477a5b9657ca4c5b84f308d871cff635930c868e855de2ce0838144af: Status 404 returned error can't find the container with id ddf11b3477a5b9657ca4c5b84f308d871cff635930c868e855de2ce0838144af Jul 02 16:58:07.566192 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:07.566170 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cdf4b8_97fb_4d02_8aff_b98a950b020a.slice/crio-4aa5b373b1df36a55be59bfc289732422f6646cc375dd92e67876bed6f17fe67 WatchSource:0}: Error finding container 4aa5b373b1df36a55be59bfc289732422f6646cc375dd92e67876bed6f17fe67: Status 404 returned error can't find the container with id 4aa5b373b1df36a55be59bfc289732422f6646cc375dd92e67876bed6f17fe67 Jul 02 16:58:07.625412 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.625362 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:07.845290 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.845254 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4m766" event={"ID":"445acc05-aa49-4cc4-839a-c72e7016c4a3","Type":"ContainerStarted","Data":"ddf11b3477a5b9657ca4c5b84f308d871cff635930c868e855de2ce0838144af"} Jul 02 16:58:07.846338 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.846316 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tkrht" event={"ID":"c5cdf4b8-97fb-4d02-8aff-b98a950b020a","Type":"ContainerStarted","Data":"4aa5b373b1df36a55be59bfc289732422f6646cc375dd92e67876bed6f17fe67"} Jul 02 16:58:07.874528 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:07.874498 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:08.046682 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:08.046506 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:08.261645 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:08.261600 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:08.646375 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:08.646280 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:09.212950 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.212914 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:58:09.216050 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.216026 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e59d903-0e6e-45b4-81ac-22102ce05577-metrics-tls\") pod \"dns-default-xnvlm\" (UID: \"1e59d903-0e6e-45b4-81ac-22102ce05577\") " pod="openshift-dns/dns-default-xnvlm" Jul 02 16:58:09.276828 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.276784 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:09.428704 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.428671 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gz8mr\"" Jul 02 16:58:09.436847 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.436817 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnvlm" Jul 02 16:58:09.439978 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.439942 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:09.663984 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.663780 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:09.890560 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:09.890448 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:10.299884 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.299846 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:10.325929 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.325894 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:10.326089 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.325946 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:10.326089 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:10.326073 2535 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:58:10.326209 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:10.326138 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls podName:56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:26.326120197 +0000 UTC m=+84.430138717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4s5p" (UID: "56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83") : secret "insights-runtime-extractor-tls" not found Jul 02 16:58:10.326513 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.326485 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:10.484522 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.484454 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:10.646762 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.646673 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:10.759197 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:10.759150 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:11.062416 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:11.062372 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:11.249854 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:11.249820 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:11.480889 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:11.480840 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:11.858504 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:11.858417 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:12.117829 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.117741 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:12.128281 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.128206 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnvlm"] Jul 02 16:58:12.131970 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:12.131939 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e59d903_0e6e_45b4_81ac_22102ce05577.slice/crio-f71817b9f960e7d51a638487096b56b272daf46efb48b438a96a706787dc5330 WatchSource:0}: Error finding container f71817b9f960e7d51a638487096b56b272daf46efb48b438a96a706787dc5330: Status 404 returned error can't find the container with id f71817b9f960e7d51a638487096b56b272daf46efb48b438a96a706787dc5330 Jul 02 16:58:12.867808 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.867770 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4m766" event={"ID":"445acc05-aa49-4cc4-839a-c72e7016c4a3","Type":"ContainerStarted","Data":"08f7df7203d39bf6d2892d59a89f3eda04ef12e1c7d925e884d9bef2e6dd95cd"} Jul 02 16:58:12.869311 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.869267 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnvlm" event={"ID":"1e59d903-0e6e-45b4-81ac-22102ce05577","Type":"ContainerStarted","Data":"f71817b9f960e7d51a638487096b56b272daf46efb48b438a96a706787dc5330"} Jul 02 16:58:12.870802 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.870778 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tkrht" event={"ID":"c5cdf4b8-97fb-4d02-8aff-b98a950b020a","Type":"ContainerStarted","Data":"ee5e567868b4387df0d10b82763e5bb8acd5f3e6ee4b6d4dfada406a70acf6dc"} Jul 02 16:58:12.870933 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.870917 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:58:12.900588 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.900516 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4m766" podStartSLOduration=66.502798448 podStartE2EDuration="1m10.900498869s" totalImagesPullingTime="4.397700421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:12.888764907 +0000 UTC m=+70.992783449" watchObservedRunningTime="2026-07-02 16:58:12.900498869 +0000 UTC m=+71.004517413" Jul 02 16:58:12.932093 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:12.932048 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tkrht" podStartSLOduration=66.538581898 podStartE2EDuration="1m10.932035189s" totalImagesPullingTime="4.393453291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:12.931530928 +0000 UTC m=+71.035549470" watchObservedRunningTime="2026-07-02 16:58:12.932035189 +0000 UTC m=+71.036053730" Jul 02 16:58:13.383720 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.383685 2535 scope.go:117] "RemoveContainer" containerID="1400f57aac8101ae87ba0189308f555352c7cddcb59f2ee95053b25484d6b15b" Jul 02 16:58:13.876471 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.876440 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 16:58:13.876867 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.876562 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" event={"ID":"bf7fe272-a14c-42aa-af6c-d9812fcc2e34","Type":"ContainerStarted","Data":"7939308364cbfd4dfa17f9f1c3b8088c565971147ca293ad884aca821b13e8a3"} Jul 02 16:58:13.876945 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.876927 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:58:13.878859 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.878834 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnvlm" event={"ID":"1e59d903-0e6e-45b4-81ac-22102ce05577","Type":"ContainerStarted","Data":"9ac047141b2ecc3e83503e86b26399f19392507a1899ef586e9f59c9780551f5"} Jul 02 16:58:13.878989 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.878894 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnvlm" event={"ID":"1e59d903-0e6e-45b4-81ac-22102ce05577","Type":"ContainerStarted","Data":"4f413cb27735ada942d69ff4c27bcce1d3570fa8e53d25bce952631189a48818"} Jul 02 16:58:13.952682 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.952626 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xnvlm" podStartSLOduration=35.425188588 podStartE2EDuration="36.952605258s" totalImagesPullingTime="1.52741667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:13.951189682 +0000 UTC m=+72.055208224" watchObservedRunningTime="2026-07-02 16:58:13.952605258 +0000 UTC m=+72.056623802" Jul 02 16:58:13.953378 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:13.953349 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" podStartSLOduration=22.919867766 podStartE2EDuration="25.953335051s" totalImagesPullingTime="3.033467285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:13.911507112 +0000 UTC m=+72.015525647" watchObservedRunningTime="2026-07-02 16:58:13.953335051 +0000 UTC m=+72.057353594" Jul 02 16:58:14.468622 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:14.468595 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7l8jd" Jul 02 16:58:14.847157 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:14.847068 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:14.882501 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:14.882462 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xnvlm" Jul 02 16:58:15.030273 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:15.030244 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:15.174920 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:15.174827 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:15.352291 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:15.352251 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:15.537863 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:15.537832 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:15.840950 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:15.840857 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:16.470888 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:16.470858 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:16.632215 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:16.632178 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:16.816265 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:16.816189 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:16.996589 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:16.996535 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:17.608930 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:17.608883 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:17.871930 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:17.871821 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:20.209668 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.209633 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:58:20.212071 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.212044 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75207b6c-e7bf-44b4-908c-403cd6a5dac3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhzt6\" (UID: \"75207b6c-e7bf-44b4-908c-403cd6a5dac3\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:58:20.310450 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.310392 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:20.310648 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.310504 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:20.311042 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.311010 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c3da69-4e81-4847-96b1-9d04e2a823bd-service-ca-bundle\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:20.312826 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.312802 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9c3da69-4e81-4847-96b1-9d04e2a823bd-metrics-certs\") pod \"router-default-c8d968c5f-mk6qb\" (UID: \"f9c3da69-4e81-4847-96b1-9d04e2a823bd\") " pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:20.411795 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.411761 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:20.414014 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.413997 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"image-registry-6dd7cb7b8-46s7l\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:20.447995 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.447965 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t8v7f\"" Jul 02 16:58:20.448964 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.448948 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" Jul 02 16:58:20.560511 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.560485 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rx47j\"" Jul 02 16:58:20.566367 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.566351 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:20.603820 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.603789 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6"] Jul 02 16:58:20.608945 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:20.608916 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75207b6c_e7bf_44b4_908c_403cd6a5dac3.slice/crio-521de0ffe58faeda81aac6e7ed985dbc19377472dd47d4ae0bc82fa817a08996 WatchSource:0}: Error finding container 521de0ffe58faeda81aac6e7ed985dbc19377472dd47d4ae0bc82fa817a08996: Status 404 returned error can't find the container with id 521de0ffe58faeda81aac6e7ed985dbc19377472dd47d4ae0bc82fa817a08996 Jul 02 16:58:20.688683 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.688656 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lw9nb\"" Jul 02 16:58:20.692073 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.692053 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:20.721262 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.721235 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c8d968c5f-mk6qb"] Jul 02 16:58:20.729411 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:20.729382 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c3da69_4e81_4847_96b1_9d04e2a823bd.slice/crio-44c446b6c06ede393dc9d49046f87c150216657467046dc12a838207689d2c7e WatchSource:0}: Error finding container 44c446b6c06ede393dc9d49046f87c150216657467046dc12a838207689d2c7e: Status 404 returned error can't find the container with id 44c446b6c06ede393dc9d49046f87c150216657467046dc12a838207689d2c7e Jul 02 16:58:20.861676 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.861647 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd7cb7b8-46s7l"] Jul 02 16:58:20.864613 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:20.864590 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514e38cf_c6d4_4a96_9111_304fed89e0f6.slice/crio-7d1b040a055fe9116ef009dff8dc1aa3b1955c6d0e2a74058404cb473c56942a WatchSource:0}: Error finding container 7d1b040a055fe9116ef009dff8dc1aa3b1955c6d0e2a74058404cb473c56942a: Status 404 returned error can't find the container with id 7d1b040a055fe9116ef009dff8dc1aa3b1955c6d0e2a74058404cb473c56942a Jul 02 16:58:20.903754 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.903725 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" event={"ID":"f9c3da69-4e81-4847-96b1-9d04e2a823bd","Type":"ContainerStarted","Data":"bb3a8f489306b055501c9d1068289f9fdabb1195574c0b97c87e5939b3daa032"} Jul 02 16:58:20.903873 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.903781 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" event={"ID":"f9c3da69-4e81-4847-96b1-9d04e2a823bd","Type":"ContainerStarted","Data":"44c446b6c06ede393dc9d49046f87c150216657467046dc12a838207689d2c7e"} Jul 02 16:58:20.905034 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.905007 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" event={"ID":"75207b6c-e7bf-44b4-908c-403cd6a5dac3","Type":"ContainerStarted","Data":"521de0ffe58faeda81aac6e7ed985dbc19377472dd47d4ae0bc82fa817a08996"} Jul 02 16:58:20.906469 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.906443 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" event={"ID":"514e38cf-c6d4-4a96-9111-304fed89e0f6","Type":"ContainerStarted","Data":"7d1b040a055fe9116ef009dff8dc1aa3b1955c6d0e2a74058404cb473c56942a"} Jul 02 16:58:20.953023 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:20.952971 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" podStartSLOduration=32.952956633 podStartE2EDuration="32.952956633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:20.952854153 +0000 UTC m=+79.056872679" watchObservedRunningTime="2026-07-02 16:58:20.952956633 +0000 UTC m=+79.056975153" Jul 02 16:58:21.567222 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.567186 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:21.569974 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.569950 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:21.637787 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.637752 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:21.911785 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.911703 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" event={"ID":"514e38cf-c6d4-4a96-9111-304fed89e0f6","Type":"ContainerStarted","Data":"6d5218d7b7e46de81777cd24903ddc07d5b0b72620aa451f377086e194a68ead"} Jul 02 16:58:21.911947 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.911867 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:21.911947 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.911938 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:21.913261 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.913231 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c8d968c5f-mk6qb" Jul 02 16:58:21.947977 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.947938 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:21.970311 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:21.970259 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" podStartSLOduration=33.970243276 podStartE2EDuration="33.970243276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:21.969559028 +0000 UTC m=+80.073577565" watchObservedRunningTime="2026-07-02 16:58:21.970243276 +0000 UTC m=+80.074261836" Jul 02 16:58:22.920120 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:22.920083 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" event={"ID":"75207b6c-e7bf-44b4-908c-403cd6a5dac3","Type":"ContainerStarted","Data":"fe0439c75ed3888ea6edec0803d61bfe717510f9bf729a96af7c2bdc89d0bf0b"} Jul 02 16:58:23.260995 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:23.260952 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:23.447063 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:23.447027 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:23.669644 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:23.669561 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:23.781348 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:23.781307 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:24.622130 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:24.622004 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:24.887476 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:24.887397 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xnvlm" Jul 02 16:58:24.909980 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:24.909916 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhzt6" podStartSLOduration=34.790827174 podStartE2EDuration="36.909902163s" totalImagesPullingTime="2.119074989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:23.004696784 +0000 UTC m=+81.108715326" watchObservedRunningTime="2026-07-02 16:58:24.909902163 +0000 UTC m=+83.013920718" Jul 02 16:58:26.361127 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.361091 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:26.363318 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.363298 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4s5p\" (UID: \"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83\") " pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:26.605764 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.605735 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4pq6p\"" Jul 02 16:58:26.608807 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.608791 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c4s5p" Jul 02 16:58:26.748529 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.748498 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c4s5p"] Jul 02 16:58:26.751510 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:26.751476 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c7ab4b_1fe2_4440_bcb6_4121e4d5ec83.slice/crio-43aae80e1edc1fac43f30b073476d3bee5ff93f07394127372334d5a13a4bea2 WatchSource:0}: Error finding container 43aae80e1edc1fac43f30b073476d3bee5ff93f07394127372334d5a13a4bea2: Status 404 returned error can't find the container with id 43aae80e1edc1fac43f30b073476d3bee5ff93f07394127372334d5a13a4bea2 Jul 02 16:58:26.870117 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.870091 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9"] Jul 02 16:58:26.874372 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.874351 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:26.878349 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.878322 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 16:58:26.878446 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.878367 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 16:58:26.878446 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.878331 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cmcs5\"" Jul 02 16:58:26.879108 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.878953 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 16:58:26.879108 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.879025 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 16:58:26.891126 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.891105 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9"] Jul 02 16:58:26.897206 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.897184 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dd7cb7b8-46s7l"] Jul 02 16:58:26.934159 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.934120 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4s5p" event={"ID":"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83","Type":"ContainerStarted","Data":"43aae80e1edc1fac43f30b073476d3bee5ff93f07394127372334d5a13a4bea2"} Jul 02 16:58:26.953086 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.953054 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25"] Jul 02 16:58:26.956133 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.956115 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:26.962860 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.962841 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-64h8z\"" Jul 02 16:58:26.963039 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.963022 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 16:58:26.972576 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.972529 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-967957fcf-wtfls"] Jul 02 16:58:26.975494 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.975479 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:26.979680 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.979660 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-fw4pq"] Jul 02 16:58:26.982788 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.982770 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25"] Jul 02 16:58:26.982869 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.982839 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:26.986620 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.986604 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-btpcw\"" Jul 02 16:58:26.986709 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.986604 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 16:58:26.986850 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:26.986834 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 16:58:27.002294 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.002270 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-967957fcf-wtfls"] Jul 02 16:58:27.003647 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.003611 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-fw4pq"] Jul 02 16:58:27.004397 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.004363 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:27.066242 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.066213 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f69dc65dd-dtmc9\" (UID: \"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.066359 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.066248 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7h97\" (UniqueName: \"kubernetes.io/projected/d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed-kube-api-access-d7h97\") pod \"managed-serviceaccount-addon-agent-f69dc65dd-dtmc9\" (UID: \"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.066359 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.066273 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4dc182f4-639f-4468-a18c-ff3129b5ff96-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tqk25\" (UID: \"4dc182f4-639f-4468-a18c-ff3129b5ff96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:27.106744 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.106716 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:27.167528 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167451 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b12a0ca-2e81-423b-9121-1b636d064593-installation-pull-secrets\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167528 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167499 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b12a0ca-2e81-423b-9121-1b636d064593-ca-trust-extracted\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167747 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167586 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-bound-sa-token\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167747 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167633 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b12a0ca-2e81-423b-9121-1b636d064593-trusted-ca\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167747 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167671 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmpt\" (UniqueName: \"kubernetes.io/projected/877b7223-2e37-4ea3-af47-27afa108efe4-kube-api-access-tkmpt\") pod \"downloads-5499b6fb8f-fw4pq\" (UID: \"877b7223-2e37-4ea3-af47-27afa108efe4\") " pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:27.167747 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167700 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b12a0ca-2e81-423b-9121-1b636d064593-registry-certificates\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167906 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167808 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b12a0ca-2e81-423b-9121-1b636d064593-image-registry-private-configuration\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167906 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167835 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2k2x\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-kube-api-access-r2k2x\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.167906 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167877 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f69dc65dd-dtmc9\" (UID: \"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.168032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167904 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7h97\" (UniqueName: \"kubernetes.io/projected/d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed-kube-api-access-d7h97\") pod \"managed-serviceaccount-addon-agent-f69dc65dd-dtmc9\" (UID: \"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.168032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167926 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-registry-tls\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.168032 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.167951 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4dc182f4-639f-4468-a18c-ff3129b5ff96-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tqk25\" (UID: \"4dc182f4-639f-4468-a18c-ff3129b5ff96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:27.170880 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.170852 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4dc182f4-639f-4468-a18c-ff3129b5ff96-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tqk25\" (UID: \"4dc182f4-639f-4468-a18c-ff3129b5ff96\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:27.171042 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.171023 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f69dc65dd-dtmc9\" (UID: \"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.204305 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.204239 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7h97\" (UniqueName: \"kubernetes.io/projected/d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed-kube-api-access-d7h97\") pod \"managed-serviceaccount-addon-agent-f69dc65dd-dtmc9\" (UID: \"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.248316 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.248241 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:27.265818 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.265554 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268400 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmpt\" (UniqueName: \"kubernetes.io/projected/877b7223-2e37-4ea3-af47-27afa108efe4-kube-api-access-tkmpt\") pod \"downloads-5499b6fb8f-fw4pq\" (UID: \"877b7223-2e37-4ea3-af47-27afa108efe4\") " pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268435 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b12a0ca-2e81-423b-9121-1b636d064593-registry-certificates\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268496 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b12a0ca-2e81-423b-9121-1b636d064593-image-registry-private-configuration\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268523 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2k2x\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-kube-api-access-r2k2x\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268573 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-registry-tls\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268614 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b12a0ca-2e81-423b-9121-1b636d064593-installation-pull-secrets\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268643 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b12a0ca-2e81-423b-9121-1b636d064593-ca-trust-extracted\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268669 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-bound-sa-token\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.269611 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.268698 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b12a0ca-2e81-423b-9121-1b636d064593-trusted-ca\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.271479 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.270831 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b12a0ca-2e81-423b-9121-1b636d064593-registry-certificates\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.271479 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.270916 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b12a0ca-2e81-423b-9121-1b636d064593-ca-trust-extracted\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.271888 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.271850 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b12a0ca-2e81-423b-9121-1b636d064593-trusted-ca\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.273733 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.273707 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b12a0ca-2e81-423b-9121-1b636d064593-image-registry-private-configuration\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.274553 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.274502 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-registry-tls\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.275785 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.275752 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b12a0ca-2e81-423b-9121-1b636d064593-installation-pull-secrets\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.287311 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.287264 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmpt\" (UniqueName: \"kubernetes.io/projected/877b7223-2e37-4ea3-af47-27afa108efe4-kube-api-access-tkmpt\") pod \"downloads-5499b6fb8f-fw4pq\" (UID: \"877b7223-2e37-4ea3-af47-27afa108efe4\") " pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:27.288636 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.288595 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-bound-sa-token\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.293631 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.293374 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:27.294234 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.294201 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2k2x\" (UniqueName: \"kubernetes.io/projected/2b12a0ca-2e81-423b-9121-1b636d064593-kube-api-access-r2k2x\") pod \"image-registry-967957fcf-wtfls\" (UID: \"2b12a0ca-2e81-423b-9121-1b636d064593\") " pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.417113 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.417055 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:27.460096 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.460014 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25"] Jul 02 16:58:27.463884 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:27.463845 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc182f4_639f_4468_a18c_ff3129b5ff96.slice/crio-b378934e2bb9de279fea560841db21704ecdfc0e5c2f5b2a66621153993d1783 WatchSource:0}: Error finding container b378934e2bb9de279fea560841db21704ecdfc0e5c2f5b2a66621153993d1783: Status 404 returned error can't find the container with id b378934e2bb9de279fea560841db21704ecdfc0e5c2f5b2a66621153993d1783 Jul 02 16:58:27.492122 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.492095 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" Jul 02 16:58:27.494153 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.494086 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-fw4pq"] Jul 02 16:58:27.584831 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.584799 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.694059 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.693950 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9"] Jul 02 16:58:27.709219 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:27.709188 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd76b77b4_2b7e_4d21_b735_31f4d1aaf8ed.slice/crio-4ef5340e0dbf32ff733a6e494b3a2578d959478c2795757b9712c552b1ea6506 WatchSource:0}: Error finding container 4ef5340e0dbf32ff733a6e494b3a2578d959478c2795757b9712c552b1ea6506: Status 404 returned error can't find the container with id 4ef5340e0dbf32ff733a6e494b3a2578d959478c2795757b9712c552b1ea6506 Jul 02 16:58:27.822782 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.822704 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-967957fcf-wtfls"] Jul 02 16:58:27.826614 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:27.826583 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b12a0ca_2e81_423b_9121_1b636d064593.slice/crio-6220cf5a0d54cad0ab3c79f3d914e6c9236fab170deab44e91187a2f5db8b12c WatchSource:0}: Error finding container 6220cf5a0d54cad0ab3c79f3d914e6c9236fab170deab44e91187a2f5db8b12c: Status 404 returned error can't find the container with id 6220cf5a0d54cad0ab3c79f3d914e6c9236fab170deab44e91187a2f5db8b12c Jul 02 16:58:27.940954 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.940910 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-967957fcf-wtfls" event={"ID":"2b12a0ca-2e81-423b-9121-1b636d064593","Type":"ContainerStarted","Data":"8f40586256d77bfeeea94c23443f6fc1c0dbd83e80370a53ba5e3e6f1efdbc63"} Jul 02 16:58:27.941119 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.940978 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-967957fcf-wtfls" event={"ID":"2b12a0ca-2e81-423b-9121-1b636d064593","Type":"ContainerStarted","Data":"6220cf5a0d54cad0ab3c79f3d914e6c9236fab170deab44e91187a2f5db8b12c"} Jul 02 16:58:27.941191 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.941119 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:27.942477 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.942443 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" event={"ID":"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed","Type":"ContainerStarted","Data":"4ef5340e0dbf32ff733a6e494b3a2578d959478c2795757b9712c552b1ea6506"} Jul 02 16:58:27.943814 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.943789 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-fw4pq" event={"ID":"877b7223-2e37-4ea3-af47-27afa108efe4","Type":"ContainerStarted","Data":"2adb3e13bfb9ff601bd46fef22bff064fbac90fc5303ad5a1edae561f191e438"} Jul 02 16:58:27.945265 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.945205 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" event={"ID":"4dc182f4-639f-4468-a18c-ff3129b5ff96","Type":"ContainerStarted","Data":"b378934e2bb9de279fea560841db21704ecdfc0e5c2f5b2a66621153993d1783"} Jul 02 16:58:27.978150 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:27.978102 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-967957fcf-wtfls" podStartSLOduration=1.978082659 podStartE2EDuration="1.978082659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:27.977179436 +0000 UTC m=+86.081197981" watchObservedRunningTime="2026-07-02 16:58:27.978082659 +0000 UTC m=+86.082101201" Jul 02 16:58:28.543261 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:28.543227 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:28.644801 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:28.644765 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:30.889345 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:30.889311 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:30.985403 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:30.985309 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:32.968337 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:32.968301 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4s5p" event={"ID":"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83","Type":"ContainerStarted","Data":"3dfc114a92e4815a59676f4a5c19886afc999b8bc09ee1ef49070302431cf616"} Jul 02 16:58:32.970188 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:32.970158 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" event={"ID":"d76b77b4-2b7e-4d21-b735-31f4d1aaf8ed","Type":"ContainerStarted","Data":"720e5911140961e9d86999f1781a5ba6844b4900f0698876dc0989d3e710912d"} Jul 02 16:58:32.971863 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:32.971836 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" event={"ID":"4dc182f4-639f-4468-a18c-ff3129b5ff96","Type":"ContainerStarted","Data":"99d387df54c323b48a6e95aedfd30e15b00ffeab69a68814a9574dbb33b707b5"} Jul 02 16:58:32.972091 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:32.972026 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:32.977380 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:32.977351 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" Jul 02 16:58:32.996182 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:32.996136 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69dc65dd-dtmc9" podStartSLOduration=1.974673399 podStartE2EDuration="6.996121617s" totalImagesPullingTime="5.021448218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:32.995209789 +0000 UTC m=+91.099228330" watchObservedRunningTime="2026-07-02 16:58:32.996121617 +0000 UTC m=+91.100140159" Jul 02 16:58:33.032273 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:33.032189 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tqk25" podStartSLOduration=1.777854689 podStartE2EDuration="7.032168448s" totalImagesPullingTime="5.254313759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:33.031290184 +0000 UTC m=+91.135308726" watchObservedRunningTime="2026-07-02 16:58:33.032168448 +0000 UTC m=+91.136186992" Jul 02 16:58:33.627281 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:33.627185 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:33.847938 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:33.847907 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:33.978437 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:33.978398 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4s5p" event={"ID":"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83","Type":"ContainerStarted","Data":"814ed1f8988260255f30d181651a7ffa7a0b80d61549b28e0a15ca55f430e5c6"} Jul 02 16:58:34.144553 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:34.144502 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:34.301719 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:34.301571 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:34.798043 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:34.798008 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:34.975137 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:34.975094 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:36.904305 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:36.904275 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:36.992696 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:36.992655 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4s5p" event={"ID":"56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83","Type":"ContainerStarted","Data":"fc1ba4070cc06fc758b0d4ad90a69db45c392b86d2521f6f013ea0e3830f303c"} Jul 02 16:58:37.023047 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:37.022992 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c4s5p" podStartSLOduration=33.704282893 podStartE2EDuration="43.022975904s" totalImagesPullingTime="9.318693011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:37.022887228 +0000 UTC m=+95.126905771" watchObservedRunningTime="2026-07-02 16:58:37.022975904 +0000 UTC m=+95.126994444" Jul 02 16:58:38.502158 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:38.502121 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:38.624291 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:38.624252 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:39.364846 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:39.364809 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:41.187159 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:41.187066 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:41.355917 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:41.355870 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:42.061157 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.061087 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:42.327052 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.326962 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:42.509930 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.509794 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:42.641874 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.640871 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7gf4r"] Jul 02 16:58:42.647643 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.647617 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.673359 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.673333 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 16:58:42.683956 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.683934 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 16:58:42.708979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.708941 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffbd9ae2-8f8c-4486-8575-42cbda633793-metrics-client-ca\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709105 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.708989 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709105 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709048 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-root\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709105 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709078 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qhn\" (UniqueName: \"kubernetes.io/projected/ffbd9ae2-8f8c-4486-8575-42cbda633793-kube-api-access-r9qhn\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709259 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709130 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-textfile\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709259 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709181 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709348 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709262 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-tls\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709348 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709294 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-wtmp\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.709348 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.709323 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-sys\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.712732 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.712702 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vvhn\"" Jul 02 16:58:42.712892 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.712750 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 16:58:42.713659 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.713628 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 16:58:42.810724 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810692 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-tls\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810724 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810729 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-wtmp\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810754 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-sys\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810820 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffbd9ae2-8f8c-4486-8575-42cbda633793-metrics-client-ca\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:42.810851 2535 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810855 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810886 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-sys\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810890 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-root\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810918 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-wtmp\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: E0702 16:58:42.810919 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-tls podName:ffbd9ae2-8f8c-4486-8575-42cbda633793 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:43.310895178 +0000 UTC m=+101.414913721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-tls") pod "node-exporter-7gf4r" (UID: "ffbd9ae2-8f8c-4486-8575-42cbda633793") : secret "node-exporter-tls" not found Jul 02 16:58:42.810975 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810924 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffbd9ae2-8f8c-4486-8575-42cbda633793-root\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.811425 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.810989 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qhn\" (UniqueName: \"kubernetes.io/projected/ffbd9ae2-8f8c-4486-8575-42cbda633793-kube-api-access-r9qhn\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.811425 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.811044 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-textfile\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.811425 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.811073 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.811621 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.811515 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.811621 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.811590 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffbd9ae2-8f8c-4486-8575-42cbda633793-metrics-client-ca\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.811621 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.811609 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-textfile\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.813622 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.813604 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:42.829322 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.829243 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:42.854144 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:42.854114 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qhn\" (UniqueName: \"kubernetes.io/projected/ffbd9ae2-8f8c-4486-8575-42cbda633793-kube-api-access-r9qhn\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:43.017204 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.017153 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:43.292450 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.292339 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:43.315309 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.315274 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-tls\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:43.318021 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.317990 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffbd9ae2-8f8c-4486-8575-42cbda633793-node-exporter-tls\") pod \"node-exporter-7gf4r\" (UID: \"ffbd9ae2-8f8c-4486-8575-42cbda633793\") " pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:43.558796 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.558718 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gf4r" Jul 02 16:58:43.598085 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.598026 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:43.857142 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.857056 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:43.882363 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:43.882332 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tkrht" Jul 02 16:58:44.471363 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:44.471327 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:44.677422 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:44.677382 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:45.133831 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:58:45.133793 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbd9ae2_8f8c_4486_8575_42cbda633793.slice/crio-37afac1dae7c3096d1e28e53c63374f514993fae409ebd8f85322b853c6b67c0 WatchSource:0}: Error finding container 37afac1dae7c3096d1e28e53c63374f514993fae409ebd8f85322b853c6b67c0: Status 404 returned error can't find the container with id 37afac1dae7c3096d1e28e53c63374f514993fae409ebd8f85322b853c6b67c0 Jul 02 16:58:45.515064 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:45.515028 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:45.719341 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:45.719302 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:46.046801 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.042447 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-fw4pq" event={"ID":"877b7223-2e37-4ea3-af47-27afa108efe4","Type":"ContainerStarted","Data":"07bd5c94bec94774880e14dae2af73d69902ae1cc69e95e75d0eb7dc06506595"} Jul 02 16:58:46.046801 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.045345 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:46.047034 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.046991 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gf4r" event={"ID":"ffbd9ae2-8f8c-4486-8575-42cbda633793","Type":"ContainerStarted","Data":"37afac1dae7c3096d1e28e53c63374f514993fae409ebd8f85322b853c6b67c0"} Jul 02 16:58:46.058050 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.058025 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-fw4pq" Jul 02 16:58:46.123639 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.122073 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-fw4pq" podStartSLOduration=2.128346019 podStartE2EDuration="20.12205239s" totalImagesPullingTime="17.993706371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:46.080357862 +0000 UTC m=+104.184376404" watchObservedRunningTime="2026-07-02 16:58:46.12205239 +0000 UTC m=+104.226070936" Jul 02 16:58:46.123639 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.123085 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:46.234044 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.233963 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:46.535789 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.535748 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:46.662646 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:46.662565 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:47.053855 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:47.053819 2535 generic.go:356] "Generic (PLEG): container finished" podID="ffbd9ae2-8f8c-4486-8575-42cbda633793" containerID="c456773e43f97eb4a6de5d6964fe478cd3d794953e2d79496f3cb858c0ac7f73" exitCode=0 Jul 02 16:58:47.054382 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:47.053929 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gf4r" event={"ID":"ffbd9ae2-8f8c-4486-8575-42cbda633793","Type":"ContainerDied","Data":"c456773e43f97eb4a6de5d6964fe478cd3d794953e2d79496f3cb858c0ac7f73"} Jul 02 16:58:47.064750 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:47.064720 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:47.267448 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:47.267412 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:47.717157 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:47.717117 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:48.060518 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:48.060435 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gf4r" event={"ID":"ffbd9ae2-8f8c-4486-8575-42cbda633793","Type":"ContainerStarted","Data":"76b2c7ec80ed21f508d1ed0ea41139aa296bb056cdabe12624b97928d39c62a3"} Jul 02 16:58:48.060518 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:48.060513 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gf4r" event={"ID":"ffbd9ae2-8f8c-4486-8575-42cbda633793","Type":"ContainerStarted","Data":"6f9d9f91c180ae5d853afa7cb31af53285db035c6ac8b2269af850848e9d3217"} Jul 02 16:58:48.092310 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:48.092255 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7gf4r" podStartSLOduration=4.976631509 podStartE2EDuration="6.092240556s" totalImagesPullingTime="1.02714336s" totalInitContainerRuntime="88.465687ms" isStatefulPod=true podCreationTimestamp="2026-07-02 16:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:48.091228906 +0000 UTC m=+106.195247449" watchObservedRunningTime="2026-07-02 16:58:48.092240556 +0000 UTC m=+106.196259098" Jul 02 16:58:48.471856 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:48.471815 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:48.566638 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:48.566589 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:48.957010 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:48.956982 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-967957fcf-wtfls" Jul 02 16:58:49.357577 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:49.357462 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:49.508979 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:49.508946 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:49.687372 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:49.687292 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:51.493333 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:51.493293 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:51.605622 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:51.605582 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:51.916857 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:51.916768 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" podUID="514e38cf-c6d4-4a96-9111-304fed89e0f6" containerName="registry" containerID="cri-o://6d5218d7b7e46de81777cd24903ddc07d5b0b72620aa451f377086e194a68ead" gracePeriod=30 Jul 02 16:58:52.078831 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.078794 2535 generic.go:356] "Generic (PLEG): container finished" podID="514e38cf-c6d4-4a96-9111-304fed89e0f6" containerID="6d5218d7b7e46de81777cd24903ddc07d5b0b72620aa451f377086e194a68ead" exitCode=0 Jul 02 16:58:52.078983 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.078856 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" event={"ID":"514e38cf-c6d4-4a96-9111-304fed89e0f6","Type":"ContainerDied","Data":"6d5218d7b7e46de81777cd24903ddc07d5b0b72620aa451f377086e194a68ead"} Jul 02 16:58:52.212718 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.212684 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:52.302463 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302424 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96z5k\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-kube-api-access-96z5k\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302463 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302470 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302713 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302513 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-image-registry-private-configuration\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302713 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302558 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/514e38cf-c6d4-4a96-9111-304fed89e0f6-ca-trust-extracted\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302713 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302586 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-installation-pull-secrets\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302713 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302661 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-trusted-ca\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302713 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302711 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-bound-sa-token\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.302970 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.302756 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-certificates\") pod \"514e38cf-c6d4-4a96-9111-304fed89e0f6\" (UID: \"514e38cf-c6d4-4a96-9111-304fed89e0f6\") " Jul 02 16:58:52.303249 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.303090 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:58:52.303343 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.303278 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:58:52.305919 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.305839 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:58:52.306041 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.305971 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-kube-api-access-96z5k" (OuterVolumeSpecName: "kube-api-access-96z5k") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "kube-api-access-96z5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:58:52.306099 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.306078 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:58:52.306921 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.306357 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:58:52.306921 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.306516 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:58:52.314100 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.314070 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514e38cf-c6d4-4a96-9111-304fed89e0f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "514e38cf-c6d4-4a96-9111-304fed89e0f6" (UID: "514e38cf-c6d4-4a96-9111-304fed89e0f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:58:52.403749 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403724 2535 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/514e38cf-c6d4-4a96-9111-304fed89e0f6-ca-trust-extracted\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403749 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403750 2535 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-installation-pull-secrets\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403763 2535 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-trusted-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403777 2535 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-bound-sa-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403787 2535 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-certificates\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403800 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96z5k\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-kube-api-access-96z5k\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403813 2535 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/514e38cf-c6d4-4a96-9111-304fed89e0f6-registry-tls\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.403926 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.403827 2535 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/514e38cf-c6d4-4a96-9111-304fed89e0f6-image-registry-private-configuration\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 16:58:52.890235 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:52.890189 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:53.014435 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:53.014390 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:53.090353 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:53.090321 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" Jul 02 16:58:53.090353 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:53.090338 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd7cb7b8-46s7l" event={"ID":"514e38cf-c6d4-4a96-9111-304fed89e0f6","Type":"ContainerDied","Data":"7d1b040a055fe9116ef009dff8dc1aa3b1955c6d0e2a74058404cb473c56942a"} Jul 02 16:58:53.090600 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:53.090421 2535 scope.go:117] "RemoveContainer" containerID="6d5218d7b7e46de81777cd24903ddc07d5b0b72620aa451f377086e194a68ead" Jul 02 16:58:53.139837 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:53.139806 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dd7cb7b8-46s7l"] Jul 02 16:58:53.151496 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:53.151441 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dd7cb7b8-46s7l"] Jul 02 16:58:54.276780 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:54.276744 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:54.389229 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:54.389201 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514e38cf-c6d4-4a96-9111-304fed89e0f6" path="/var/lib/kubelet/pods/514e38cf-c6d4-4a96-9111-304fed89e0f6/volumes" Jul 02 16:58:54.409969 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:54.409941 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:55.454350 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:55.454316 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:55.566176 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:55.566142 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:58.470853 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:58.470822 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:58.643849 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:58.643809 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:59.539310 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:59.539271 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:58:59.667733 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:58:59.667693 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:00.737950 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:00.737917 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:00.843086 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:00.843050 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:03.093607 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:03.093568 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:03.156209 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:03.156173 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:04.752031 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:04.751993 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:04.898552 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:04.898498 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:05.028859 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:05.028776 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:05.737869 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:05.737836 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:05.838231 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:05.838204 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:11.153484 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:11.153445 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:59:11.156019 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:11.155990 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c4e6563-c355-4c14-acd4-b2b1b8981e11-metrics-certs\") pod \"network-metrics-daemon-ls4jm\" (UID: \"8c4e6563-c355-4c14-acd4-b2b1b8981e11\") " pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:59:11.399655 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:11.399624 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzcqc\"" Jul 02 16:59:11.407725 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:11.407666 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls4jm" Jul 02 16:59:11.568662 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:11.568633 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ls4jm"] Jul 02 16:59:11.572281 ip-10-0-128-105 kubenswrapper[2535]: W0702 16:59:11.572257 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4e6563_c355_4c14_acd4_b2b1b8981e11.slice/crio-2fb4a0e03748945fc379c2feefa249d4230225548437bbc57d521290f1836bc9 WatchSource:0}: Error finding container 2fb4a0e03748945fc379c2feefa249d4230225548437bbc57d521290f1836bc9: Status 404 returned error can't find the container with id 2fb4a0e03748945fc379c2feefa249d4230225548437bbc57d521290f1836bc9 Jul 02 16:59:12.161839 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:12.161796 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ls4jm" event={"ID":"8c4e6563-c355-4c14-acd4-b2b1b8981e11","Type":"ContainerStarted","Data":"2fb4a0e03748945fc379c2feefa249d4230225548437bbc57d521290f1836bc9"} Jul 02 16:59:13.166516 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:13.166483 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ls4jm" event={"ID":"8c4e6563-c355-4c14-acd4-b2b1b8981e11","Type":"ContainerStarted","Data":"26554086d1e99ec0cbe4b692bf36b76a4a3750b86e2892201f2ac2ed1be4a9c7"} Jul 02 16:59:13.167789 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:13.167759 2535 generic.go:356] "Generic (PLEG): container finished" podID="42a88e60-14d8-491d-9d1d-e71c8ebe02fe" containerID="ab249ad8aefbdcbe22860858dd4de6f43cd9f076891f43a3c1518a7456153bd0" exitCode=0 Jul 02 16:59:13.167893 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:13.167838 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" event={"ID":"42a88e60-14d8-491d-9d1d-e71c8ebe02fe","Type":"ContainerDied","Data":"ab249ad8aefbdcbe22860858dd4de6f43cd9f076891f43a3c1518a7456153bd0"} Jul 02 16:59:13.168151 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:13.168137 2535 scope.go:117] "RemoveContainer" containerID="ab249ad8aefbdcbe22860858dd4de6f43cd9f076891f43a3c1518a7456153bd0" Jul 02 16:59:14.172699 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:14.172657 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ls4jm" event={"ID":"8c4e6563-c355-4c14-acd4-b2b1b8981e11","Type":"ContainerStarted","Data":"905e3231b2431b6d5351767ec5368037d7d2c97f550bbf8f0c0674d2c84fcf36"} Jul 02 16:59:14.174320 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:14.174298 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-gpf2z" event={"ID":"42a88e60-14d8-491d-9d1d-e71c8ebe02fe","Type":"ContainerStarted","Data":"cb591c784d90fbf701ee30e29b4628408ae330624eabbd6137a963558f60da15"} Jul 02 16:59:14.193999 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:14.193952 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ls4jm" podStartSLOduration=130.76744082 podStartE2EDuration="2m12.193938702s" totalImagesPullingTime="1.426497882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:14.193792338 +0000 UTC m=+132.297810881" watchObservedRunningTime="2026-07-02 16:59:14.193938702 +0000 UTC m=+132.297957244" Jul 02 16:59:14.330610 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:14.330573 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:14.432654 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:14.432569 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:25.410914 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:25.410874 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:25.512111 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:25.512062 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 16:59:37.851051 ip-10-0-128-105 kubenswrapper[2535]: I0702 16:59:37.851017 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:02.483894 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:02.483804 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:02.773018 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:02.772900 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:11.254721 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:11.254690 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:11.357564 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:11.357518 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:21.748927 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:21.748882 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:21.856508 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:21.856471 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:21.945443 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:21.945404 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:28.545968 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:28.545934 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:33.220597 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:33.220563 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:40.544000 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:40.543961 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:00:40.603114 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:00:40.603080 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:17.757025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:17.756983 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:17.859198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:17.859167 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:25.795254 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:25.795164 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:25.899726 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:25.899694 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:25.956556 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:25.956494 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:26.500676 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:26.500644 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:26.554262 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:26.554232 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:29.708042 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:29.707999 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:29.774225 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:29.774194 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:36.912808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:36.912764 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:36.969340 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:36.969308 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:37.029693 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:37.029661 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:40.419651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:40.419603 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:01:40.517579 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:01:40.517525 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:01.888425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:01.888381 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:02.265196 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:02.265159 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:02:02.272421 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:02.272400 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:02:02.272904 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:02.272887 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:02:02.275527 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:02.275506 2535 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 17:02:02.281141 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:02.281120 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:02:19.722301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:19.722264 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:20.598746 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.598708 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf"] Jul 02 17:02:20.598974 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.598961 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514e38cf-c6d4-4a96-9111-304fed89e0f6" containerName="registry" Jul 02 17:02:20.599025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.598975 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="514e38cf-c6d4-4a96-9111-304fed89e0f6" containerName="registry" Jul 02 17:02:20.599063 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.599037 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="514e38cf-c6d4-4a96-9111-304fed89e0f6" containerName="registry" Jul 02 17:02:20.601004 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.600988 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.604326 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.604296 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 17:02:20.604872 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.604852 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 17:02:20.604978 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.604857 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4fps8\"" Jul 02 17:02:20.614399 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.614374 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf"] Jul 02 17:02:20.643588 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.643535 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.643588 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.643589 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.643749 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.643637 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zksw\" (UniqueName: \"kubernetes.io/projected/0c40cafb-af11-4f98-bab7-b121e919df5f-kube-api-access-9zksw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.744850 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.744800 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zksw\" (UniqueName: \"kubernetes.io/projected/0c40cafb-af11-4f98-bab7-b121e919df5f-kube-api-access-9zksw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.745323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.744908 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.745323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.744939 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.745323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.745307 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.745461 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.745360 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.754025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.753996 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zksw\" (UniqueName: \"kubernetes.io/projected/0c40cafb-af11-4f98-bab7-b121e919df5f-kube-api-access-9zksw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.910368 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.910265 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:20.926381 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:20.926339 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:21.037668 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:21.037632 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf"] Jul 02 17:02:21.041948 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:02:21.041919 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c40cafb_af11_4f98_bab7_b121e919df5f.slice/crio-191cf55c11f6252858a4ac2139d83e352f596c3205b8f19d261229b333dc00bf WatchSource:0}: Error finding container 191cf55c11f6252858a4ac2139d83e352f596c3205b8f19d261229b333dc00bf: Status 404 returned error can't find the container with id 191cf55c11f6252858a4ac2139d83e352f596c3205b8f19d261229b333dc00bf Jul 02 17:02:21.043945 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:21.043928 2535 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:02:21.821830 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:21.821784 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" event={"ID":"0c40cafb-af11-4f98-bab7-b121e919df5f","Type":"ContainerStarted","Data":"191cf55c11f6252858a4ac2139d83e352f596c3205b8f19d261229b333dc00bf"} Jul 02 17:02:28.851698 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:28.851664 2535 generic.go:356] "Generic (PLEG): container finished" podID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerID="5b87495d7d7b82bab65320fc797ba3966c435ea9866dddcfecef61d4494f877a" exitCode=0 Jul 02 17:02:28.852115 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:28.851733 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" event={"ID":"0c40cafb-af11-4f98-bab7-b121e919df5f","Type":"ContainerDied","Data":"5b87495d7d7b82bab65320fc797ba3966c435ea9866dddcfecef61d4494f877a"} Jul 02 17:02:31.864922 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:31.864830 2535 generic.go:356] "Generic (PLEG): container finished" podID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerID="e1cf90aa0f771f70870a5e93481db0b0328bf88fde9374f8568fa6f23b529def" exitCode=0 Jul 02 17:02:31.865289 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:31.864922 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" event={"ID":"0c40cafb-af11-4f98-bab7-b121e919df5f","Type":"ContainerDied","Data":"e1cf90aa0f771f70870a5e93481db0b0328bf88fde9374f8568fa6f23b529def"} Jul 02 17:02:38.896460 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:38.896428 2535 generic.go:356] "Generic (PLEG): container finished" podID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerID="d4b3ae764dd9253685e36af71c0ef098b56fd0d714ca8ca592ddf3e0e32013fb" exitCode=0 Jul 02 17:02:38.896829 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:38.896494 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" event={"ID":"0c40cafb-af11-4f98-bab7-b121e919df5f","Type":"ContainerDied","Data":"d4b3ae764dd9253685e36af71c0ef098b56fd0d714ca8ca592ddf3e0e32013fb"} Jul 02 17:02:40.025531 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.025506 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:40.097910 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.097867 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zksw\" (UniqueName: \"kubernetes.io/projected/0c40cafb-af11-4f98-bab7-b121e919df5f-kube-api-access-9zksw\") pod \"0c40cafb-af11-4f98-bab7-b121e919df5f\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " Jul 02 17:02:40.097910 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.097912 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-util\") pod \"0c40cafb-af11-4f98-bab7-b121e919df5f\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " Jul 02 17:02:40.098165 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.097957 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-bundle\") pod \"0c40cafb-af11-4f98-bab7-b121e919df5f\" (UID: \"0c40cafb-af11-4f98-bab7-b121e919df5f\") " Jul 02 17:02:40.098822 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.098786 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-bundle" (OuterVolumeSpecName: "bundle") pod "0c40cafb-af11-4f98-bab7-b121e919df5f" (UID: "0c40cafb-af11-4f98-bab7-b121e919df5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:02:40.100063 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.100042 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c40cafb-af11-4f98-bab7-b121e919df5f-kube-api-access-9zksw" (OuterVolumeSpecName: "kube-api-access-9zksw") pod "0c40cafb-af11-4f98-bab7-b121e919df5f" (UID: "0c40cafb-af11-4f98-bab7-b121e919df5f"). InnerVolumeSpecName "kube-api-access-9zksw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:02:40.103708 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.103683 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-util" (OuterVolumeSpecName: "util") pod "0c40cafb-af11-4f98-bab7-b121e919df5f" (UID: "0c40cafb-af11-4f98-bab7-b121e919df5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:02:40.199309 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.199222 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zksw\" (UniqueName: \"kubernetes.io/projected/0c40cafb-af11-4f98-bab7-b121e919df5f-kube-api-access-9zksw\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:02:40.199309 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.199255 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:02:40.199309 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.199265 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c40cafb-af11-4f98-bab7-b121e919df5f-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:02:40.905325 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.905288 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" event={"ID":"0c40cafb-af11-4f98-bab7-b121e919df5f","Type":"ContainerDied","Data":"191cf55c11f6252858a4ac2139d83e352f596c3205b8f19d261229b333dc00bf"} Jul 02 17:02:40.905480 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.905367 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="191cf55c11f6252858a4ac2139d83e352f596c3205b8f19d261229b333dc00bf" Jul 02 17:02:40.905480 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:40.905305 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540269cf" Jul 02 17:02:46.619796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:46.619760 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:47.503975 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:47.503925 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:48.594128 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594087 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc"] Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594458 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="extract" Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594474 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="extract" Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594491 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="pull" Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594498 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="pull" Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594510 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="util" Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594519 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="util" Jul 02 17:02:48.594616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.594612 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c40cafb-af11-4f98-bab7-b121e919df5f" containerName="extract" Jul 02 17:02:48.597766 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.597744 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.600399 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.600379 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d45dz\"" Jul 02 17:02:48.600657 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.600643 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 17:02:48.600738 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.600675 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 17:02:48.612839 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.612800 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc"] Jul 02 17:02:48.664691 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.664658 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb751d25-0290-4123-bc7b-e3521eb5c992-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lkcc\" (UID: \"eb751d25-0290-4123-bc7b-e3521eb5c992\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.664844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.664701 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz852\" (UniqueName: \"kubernetes.io/projected/eb751d25-0290-4123-bc7b-e3521eb5c992-kube-api-access-qz852\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lkcc\" (UID: \"eb751d25-0290-4123-bc7b-e3521eb5c992\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.765742 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.765710 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb751d25-0290-4123-bc7b-e3521eb5c992-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lkcc\" (UID: \"eb751d25-0290-4123-bc7b-e3521eb5c992\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.765742 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.765756 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz852\" (UniqueName: \"kubernetes.io/projected/eb751d25-0290-4123-bc7b-e3521eb5c992-kube-api-access-qz852\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lkcc\" (UID: \"eb751d25-0290-4123-bc7b-e3521eb5c992\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.766110 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.766091 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb751d25-0290-4123-bc7b-e3521eb5c992-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lkcc\" (UID: \"eb751d25-0290-4123-bc7b-e3521eb5c992\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.775089 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.775063 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz852\" (UniqueName: \"kubernetes.io/projected/eb751d25-0290-4123-bc7b-e3521eb5c992-kube-api-access-qz852\") pod \"cert-manager-operator-controller-manager-55c444bf86-6lkcc\" (UID: \"eb751d25-0290-4123-bc7b-e3521eb5c992\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:48.906889 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:48.906813 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" Jul 02 17:02:49.040704 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:49.040677 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc"] Jul 02 17:02:49.043608 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:02:49.043581 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb751d25_0290_4123_bc7b_e3521eb5c992.slice/crio-7e7e93e1c2f40b9737871baa1f70e025f5af1065c47659adcb2571bf342cc1f0 WatchSource:0}: Error finding container 7e7e93e1c2f40b9737871baa1f70e025f5af1065c47659adcb2571bf342cc1f0: Status 404 returned error can't find the container with id 7e7e93e1c2f40b9737871baa1f70e025f5af1065c47659adcb2571bf342cc1f0 Jul 02 17:02:49.942982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:49.942938 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" event={"ID":"eb751d25-0290-4123-bc7b-e3521eb5c992","Type":"ContainerStarted","Data":"7e7e93e1c2f40b9737871baa1f70e025f5af1065c47659adcb2571bf342cc1f0"} Jul 02 17:02:50.244143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:50.244087 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:50.355293 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:50.355232 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:50.948276 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:50.948190 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" event={"ID":"eb751d25-0290-4123-bc7b-e3521eb5c992","Type":"ContainerStarted","Data":"dc8113f65a25664621ca0679d2274cfd9f9c47e73f6b33fc8d0de34cfdfe7f93"} Jul 02 17:02:50.969600 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:50.969528 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6lkcc" podStartSLOduration=1.394576901 podStartE2EDuration="2.969511508s" totalImagesPullingTime="1.574934607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:02:50.966852967 +0000 UTC m=+349.070871508" watchObservedRunningTime="2026-07-02 17:02:50.969511508 +0000 UTC m=+349.073530042" Jul 02 17:02:51.389808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:51.389772 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:51.513260 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:51.513215 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:52.275071 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.275034 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:52.328172 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.328135 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78"] Jul 02 17:02:52.331567 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.331533 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.333991 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.333967 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 17:02:52.334806 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.334788 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4fps8\"" Jul 02 17:02:52.334891 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.334805 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 17:02:52.346466 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.346442 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78"] Jul 02 17:02:52.354589 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.354560 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:52.396808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.396783 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.396942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.396848 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.396942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.396921 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sxd7\" (UniqueName: \"kubernetes.io/projected/90a2ca39-d234-4915-835d-2b7ea683b63a-kube-api-access-4sxd7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.497655 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.497626 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.497814 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.497670 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sxd7\" (UniqueName: \"kubernetes.io/projected/90a2ca39-d234-4915-835d-2b7ea683b63a-kube-api-access-4sxd7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.497814 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.497721 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.498063 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.498043 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.498105 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.498060 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.505796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.505777 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sxd7\" (UniqueName: \"kubernetes.io/projected/90a2ca39-d234-4915-835d-2b7ea683b63a-kube-api-access-4sxd7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.640465 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.640392 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:52.769596 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.769572 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78"] Jul 02 17:02:52.772473 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:02:52.772445 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a2ca39_d234_4915_835d_2b7ea683b63a.slice/crio-218f4531a866f5c90ed39d545386d9bf0605f5035f0d9f10405e8b4684772810 WatchSource:0}: Error finding container 218f4531a866f5c90ed39d545386d9bf0605f5035f0d9f10405e8b4684772810: Status 404 returned error can't find the container with id 218f4531a866f5c90ed39d545386d9bf0605f5035f0d9f10405e8b4684772810 Jul 02 17:02:52.958363 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.958327 2535 generic.go:356] "Generic (PLEG): container finished" podID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerID="997b975c0d9dace34d856b9effeb3e48f0ca6dbd39d0bd7967ea7569e236cd91" exitCode=0 Jul 02 17:02:52.958558 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.958386 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" event={"ID":"90a2ca39-d234-4915-835d-2b7ea683b63a","Type":"ContainerDied","Data":"997b975c0d9dace34d856b9effeb3e48f0ca6dbd39d0bd7967ea7569e236cd91"} Jul 02 17:02:52.958558 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:52.958421 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" event={"ID":"90a2ca39-d234-4915-835d-2b7ea683b63a","Type":"ContainerStarted","Data":"218f4531a866f5c90ed39d545386d9bf0605f5035f0d9f10405e8b4684772810"} Jul 02 17:02:54.286825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:54.286735 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:54.675133 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:54.675095 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:54.968609 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:54.968577 2535 generic.go:356] "Generic (PLEG): container finished" podID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerID="86c0ad2ccb2aceafea06ec2e400948bb0ad6f6cca2f5e7e58a5c7d25505fc7f8" exitCode=0 Jul 02 17:02:54.968768 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:54.968630 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" event={"ID":"90a2ca39-d234-4915-835d-2b7ea683b63a","Type":"ContainerDied","Data":"86c0ad2ccb2aceafea06ec2e400948bb0ad6f6cca2f5e7e58a5c7d25505fc7f8"} Jul 02 17:02:55.974585 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:55.974533 2535 generic.go:356] "Generic (PLEG): container finished" podID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerID="9963feee1a5f852b9f3ca259c04afc6e0068591e50fb0b43bef414835231ffa4" exitCode=0 Jul 02 17:02:55.974939 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:55.974588 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" event={"ID":"90a2ca39-d234-4915-835d-2b7ea683b63a","Type":"ContainerDied","Data":"9963feee1a5f852b9f3ca259c04afc6e0068591e50fb0b43bef414835231ffa4"} Jul 02 17:02:57.032347 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.032310 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:57.100567 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.100524 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:57.145691 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.145660 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:02:57.233417 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.233325 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-bundle\") pod \"90a2ca39-d234-4915-835d-2b7ea683b63a\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " Jul 02 17:02:57.233417 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.233369 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-util\") pod \"90a2ca39-d234-4915-835d-2b7ea683b63a\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " Jul 02 17:02:57.233417 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.233412 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sxd7\" (UniqueName: \"kubernetes.io/projected/90a2ca39-d234-4915-835d-2b7ea683b63a-kube-api-access-4sxd7\") pod \"90a2ca39-d234-4915-835d-2b7ea683b63a\" (UID: \"90a2ca39-d234-4915-835d-2b7ea683b63a\") " Jul 02 17:02:57.233830 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.233803 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-bundle" (OuterVolumeSpecName: "bundle") pod "90a2ca39-d234-4915-835d-2b7ea683b63a" (UID: "90a2ca39-d234-4915-835d-2b7ea683b63a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:02:57.235457 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.235422 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a2ca39-d234-4915-835d-2b7ea683b63a-kube-api-access-4sxd7" (OuterVolumeSpecName: "kube-api-access-4sxd7") pod "90a2ca39-d234-4915-835d-2b7ea683b63a" (UID: "90a2ca39-d234-4915-835d-2b7ea683b63a"). InnerVolumeSpecName "kube-api-access-4sxd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:02:57.239378 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.239353 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-util" (OuterVolumeSpecName: "util") pod "90a2ca39-d234-4915-835d-2b7ea683b63a" (UID: "90a2ca39-d234-4915-835d-2b7ea683b63a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:02:57.334444 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.334413 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sxd7\" (UniqueName: \"kubernetes.io/projected/90a2ca39-d234-4915-835d-2b7ea683b63a-kube-api-access-4sxd7\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:02:57.334444 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.334440 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:02:57.334444 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.334451 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a2ca39-d234-4915-835d-2b7ea683b63a-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:02:57.983783 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.983749 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" event={"ID":"90a2ca39-d234-4915-835d-2b7ea683b63a","Type":"ContainerDied","Data":"218f4531a866f5c90ed39d545386d9bf0605f5035f0d9f10405e8b4684772810"} Jul 02 17:02:57.983783 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.983785 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42d78" Jul 02 17:02:57.983980 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:02:57.983793 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="218f4531a866f5c90ed39d545386d9bf0605f5035f0d9f10405e8b4684772810" Jul 02 17:03:00.118223 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:00.118185 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:00.216128 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:00.216091 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:02.444974 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:02.444938 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:02.546054 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:02.546014 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:02.893105 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:02.893068 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:04.463789 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.463753 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x"] Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464008 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="pull" Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464018 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="pull" Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464032 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="util" Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464038 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="util" Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464044 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="extract" Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464050 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="extract" Jul 02 17:03:04.464167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.464096 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a2ca39-d234-4915-835d-2b7ea683b63a" containerName="extract" Jul 02 17:03:04.466012 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.465996 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.468474 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.468453 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 17:03:04.468622 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.468462 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-74fgs\"" Jul 02 17:03:04.469225 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.469212 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 17:03:04.478224 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.478203 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x"] Jul 02 17:03:04.593087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.593055 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b09306ac-1389-4750-8992-ed22b6195bd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qml7x\" (UID: \"b09306ac-1389-4750-8992-ed22b6195bd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.593239 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.593128 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq88q\" (UniqueName: \"kubernetes.io/projected/b09306ac-1389-4750-8992-ed22b6195bd1-kube-api-access-qq88q\") pod \"openshift-lws-operator-fd8ccff4c-qml7x\" (UID: \"b09306ac-1389-4750-8992-ed22b6195bd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.694328 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.694288 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b09306ac-1389-4750-8992-ed22b6195bd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qml7x\" (UID: \"b09306ac-1389-4750-8992-ed22b6195bd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.694492 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.694357 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq88q\" (UniqueName: \"kubernetes.io/projected/b09306ac-1389-4750-8992-ed22b6195bd1-kube-api-access-qq88q\") pod \"openshift-lws-operator-fd8ccff4c-qml7x\" (UID: \"b09306ac-1389-4750-8992-ed22b6195bd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.694727 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.694708 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b09306ac-1389-4750-8992-ed22b6195bd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qml7x\" (UID: \"b09306ac-1389-4750-8992-ed22b6195bd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.702708 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.702682 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq88q\" (UniqueName: \"kubernetes.io/projected/b09306ac-1389-4750-8992-ed22b6195bd1-kube-api-access-qq88q\") pod \"openshift-lws-operator-fd8ccff4c-qml7x\" (UID: \"b09306ac-1389-4750-8992-ed22b6195bd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.774792 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.774727 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" Jul 02 17:03:04.900479 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:04.900392 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x"] Jul 02 17:03:04.902620 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:04.902591 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb09306ac_1389_4750_8992_ed22b6195bd1.slice/crio-4ca45646d183fa9568e1a5e3372764aa7e301a7d5e0f617a6f56b00043e06d84 WatchSource:0}: Error finding container 4ca45646d183fa9568e1a5e3372764aa7e301a7d5e0f617a6f56b00043e06d84: Status 404 returned error can't find the container with id 4ca45646d183fa9568e1a5e3372764aa7e301a7d5e0f617a6f56b00043e06d84 Jul 02 17:03:05.010262 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:05.010228 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" event={"ID":"b09306ac-1389-4750-8992-ed22b6195bd1","Type":"ContainerStarted","Data":"4ca45646d183fa9568e1a5e3372764aa7e301a7d5e0f617a6f56b00043e06d84"} Jul 02 17:03:07.024721 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:07.024680 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" event={"ID":"b09306ac-1389-4750-8992-ed22b6195bd1","Type":"ContainerStarted","Data":"97d53363de9be041b0714801cfea6187159a662324f52e2785302821cd036124"} Jul 02 17:03:07.046760 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:07.046710 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qml7x" podStartSLOduration=1.410883866 podStartE2EDuration="3.046695259s" totalImagesPullingTime="1.635811393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:07.045817516 +0000 UTC m=+365.149836061" watchObservedRunningTime="2026-07-02 17:03:07.046695259 +0000 UTC m=+365.150713802" Jul 02 17:03:07.742364 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:07.742335 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:07.841596 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:07.841527 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:09.569515 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:09.569482 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:10.114774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.114741 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz"] Jul 02 17:03:10.118079 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.118063 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.120529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.120505 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 17:03:10.120722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.120579 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4fps8\"" Jul 02 17:03:10.121326 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.121307 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 17:03:10.127467 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.127444 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz"] Jul 02 17:03:10.241491 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.241459 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.241683 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.241498 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.241683 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.241525 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7z98\" (UniqueName: \"kubernetes.io/projected/2e6cba1b-c182-4903-b510-0ffc8cd1d434-kube-api-access-c7z98\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.342908 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.342873 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.343071 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.342918 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.343071 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.342955 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7z98\" (UniqueName: \"kubernetes.io/projected/2e6cba1b-c182-4903-b510-0ffc8cd1d434-kube-api-access-c7z98\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.343260 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.343238 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.343318 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.343264 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.354822 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.354797 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7z98\" (UniqueName: \"kubernetes.io/projected/2e6cba1b-c182-4903-b510-0ffc8cd1d434-kube-api-access-c7z98\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.428185 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.428105 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:10.553823 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:10.553790 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz"] Jul 02 17:03:10.556714 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:10.556684 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6cba1b_c182_4903_b510_0ffc8cd1d434.slice/crio-c671b8d056b0290b4dbd74dd0ed924146f92dc4d5ed89cd03120266334632331 WatchSource:0}: Error finding container c671b8d056b0290b4dbd74dd0ed924146f92dc4d5ed89cd03120266334632331: Status 404 returned error can't find the container with id c671b8d056b0290b4dbd74dd0ed924146f92dc4d5ed89cd03120266334632331 Jul 02 17:03:11.043673 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:11.043639 2535 generic.go:356] "Generic (PLEG): container finished" podID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerID="ce5924b0112c9c0bffcf459852b49171faa2c737c8d2ec8775a94aeeba8de525" exitCode=0 Jul 02 17:03:11.044076 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:11.043728 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" event={"ID":"2e6cba1b-c182-4903-b510-0ffc8cd1d434","Type":"ContainerDied","Data":"ce5924b0112c9c0bffcf459852b49171faa2c737c8d2ec8775a94aeeba8de525"} Jul 02 17:03:11.044076 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:11.043780 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" event={"ID":"2e6cba1b-c182-4903-b510-0ffc8cd1d434","Type":"ContainerStarted","Data":"c671b8d056b0290b4dbd74dd0ed924146f92dc4d5ed89cd03120266334632331"} Jul 02 17:03:12.049468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:12.049432 2535 generic.go:356] "Generic (PLEG): container finished" podID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerID="24fc9e19dda63eab2e524257278ee7db1a03c624431e590d25f607956d5e8b90" exitCode=0 Jul 02 17:03:12.049922 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:12.049473 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" event={"ID":"2e6cba1b-c182-4903-b510-0ffc8cd1d434","Type":"ContainerDied","Data":"24fc9e19dda63eab2e524257278ee7db1a03c624431e590d25f607956d5e8b90"} Jul 02 17:03:13.055516 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:13.055480 2535 generic.go:356] "Generic (PLEG): container finished" podID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerID="36e0efbecfdb6a7a07b62c006c5e8ac0d56bb63e86908f8fdb307421f13894be" exitCode=0 Jul 02 17:03:13.055921 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:13.055564 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" event={"ID":"2e6cba1b-c182-4903-b510-0ffc8cd1d434","Type":"ContainerDied","Data":"36e0efbecfdb6a7a07b62c006c5e8ac0d56bb63e86908f8fdb307421f13894be"} Jul 02 17:03:14.212606 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.212578 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:14.378738 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.378646 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-util\") pod \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " Jul 02 17:03:14.378738 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.378710 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-bundle\") pod \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " Jul 02 17:03:14.378971 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.378751 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7z98\" (UniqueName: \"kubernetes.io/projected/2e6cba1b-c182-4903-b510-0ffc8cd1d434-kube-api-access-c7z98\") pod \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\" (UID: \"2e6cba1b-c182-4903-b510-0ffc8cd1d434\") " Jul 02 17:03:14.379433 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.379404 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-bundle" (OuterVolumeSpecName: "bundle") pod "2e6cba1b-c182-4903-b510-0ffc8cd1d434" (UID: "2e6cba1b-c182-4903-b510-0ffc8cd1d434"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:03:14.380864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.380841 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6cba1b-c182-4903-b510-0ffc8cd1d434-kube-api-access-c7z98" (OuterVolumeSpecName: "kube-api-access-c7z98") pod "2e6cba1b-c182-4903-b510-0ffc8cd1d434" (UID: "2e6cba1b-c182-4903-b510-0ffc8cd1d434"). InnerVolumeSpecName "kube-api-access-c7z98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:03:14.384096 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.384059 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-util" (OuterVolumeSpecName: "util") pod "2e6cba1b-c182-4903-b510-0ffc8cd1d434" (UID: "2e6cba1b-c182-4903-b510-0ffc8cd1d434"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:03:14.479879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.479842 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:03:14.479879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.479871 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7z98\" (UniqueName: \"kubernetes.io/projected/2e6cba1b-c182-4903-b510-0ffc8cd1d434-kube-api-access-c7z98\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:03:14.479879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:14.479881 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6cba1b-c182-4903-b510-0ffc8cd1d434-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:03:15.065937 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:15.065908 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" Jul 02 17:03:15.066100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:15.065899 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcfqnz" event={"ID":"2e6cba1b-c182-4903-b510-0ffc8cd1d434","Type":"ContainerDied","Data":"c671b8d056b0290b4dbd74dd0ed924146f92dc4d5ed89cd03120266334632331"} Jul 02 17:03:15.066100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:15.066047 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c671b8d056b0290b4dbd74dd0ed924146f92dc4d5ed89cd03120266334632331" Jul 02 17:03:25.636908 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:25.636868 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:25.733249 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:25.733214 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:26.273288 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.273253 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:26.464090 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.464053 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:26.572100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.572014 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:26.602453 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602422 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx"] Jul 02 17:03:26.602706 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602693 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="pull" Jul 02 17:03:26.602758 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602707 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="pull" Jul 02 17:03:26.602758 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602721 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="util" Jul 02 17:03:26.602758 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602728 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="util" Jul 02 17:03:26.602758 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602744 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="extract" Jul 02 17:03:26.602758 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602749 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="extract" Jul 02 17:03:26.602924 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.602797 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e6cba1b-c182-4903-b510-0ffc8cd1d434" containerName="extract" Jul 02 17:03:26.607029 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.607008 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.609307 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.609279 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 17:03:26.609429 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.609360 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2dzb5\"" Jul 02 17:03:26.609748 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.609727 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 17:03:26.609863 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.609784 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 17:03:26.609929 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.609887 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 17:03:26.627337 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.627310 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx"] Jul 02 17:03:26.670630 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.670592 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c310c8e6-58d6-49b9-8453-b1fad4cae299-webhook-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.671044 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.670644 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c310c8e6-58d6-49b9-8453-b1fad4cae299-manifests\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.671044 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.670664 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjzsv\" (UniqueName: \"kubernetes.io/projected/c310c8e6-58d6-49b9-8453-b1fad4cae299-kube-api-access-tjzsv\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.671044 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.670710 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c310c8e6-58d6-49b9-8453-b1fad4cae299-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.671044 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.670804 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c310c8e6-58d6-49b9-8453-b1fad4cae299-tmp\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.771201 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.771164 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c310c8e6-58d6-49b9-8453-b1fad4cae299-tmp\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.771371 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.771219 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c310c8e6-58d6-49b9-8453-b1fad4cae299-webhook-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.771371 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.771311 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c310c8e6-58d6-49b9-8453-b1fad4cae299-manifests\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.771371 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.771328 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjzsv\" (UniqueName: \"kubernetes.io/projected/c310c8e6-58d6-49b9-8453-b1fad4cae299-kube-api-access-tjzsv\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.771371 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.771350 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c310c8e6-58d6-49b9-8453-b1fad4cae299-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.771750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.771721 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c310c8e6-58d6-49b9-8453-b1fad4cae299-manifests\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.773660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.773639 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c310c8e6-58d6-49b9-8453-b1fad4cae299-tmp\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.773805 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.773782 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c310c8e6-58d6-49b9-8453-b1fad4cae299-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.773905 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.773892 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c310c8e6-58d6-49b9-8453-b1fad4cae299-webhook-cert\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.789063 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.789039 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjzsv\" (UniqueName: \"kubernetes.io/projected/c310c8e6-58d6-49b9-8453-b1fad4cae299-kube-api-access-tjzsv\") pod \"opendatahub-operator-controller-manager-7758cbfb47-hvqhx\" (UID: \"c310c8e6-58d6-49b9-8453-b1fad4cae299\") " pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:26.806664 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.806636 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:26.906419 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.906335 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:26.917257 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:26.917230 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:27.006984 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.006939 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:27.053566 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.053517 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx"] Jul 02 17:03:27.056310 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:27.056286 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc310c8e6_58d6_49b9_8453_b1fad4cae299.slice/crio-9847cd1ef631f864dde432e997d7ddc440997dd6646b5652a554c536196b8bf2 WatchSource:0}: Error finding container 9847cd1ef631f864dde432e997d7ddc440997dd6646b5652a554c536196b8bf2: Status 404 returned error can't find the container with id 9847cd1ef631f864dde432e997d7ddc440997dd6646b5652a554c536196b8bf2 Jul 02 17:03:27.075772 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.075742 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:27.117697 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.117668 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" event={"ID":"c310c8e6-58d6-49b9-8453-b1fad4cae299","Type":"ContainerStarted","Data":"9847cd1ef631f864dde432e997d7ddc440997dd6646b5652a554c536196b8bf2"} Jul 02 17:03:27.160433 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.160347 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:27.262630 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.262588 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:27.880180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.880125 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:27.992660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:27.992623 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:31.138762 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:31.138724 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" event={"ID":"c310c8e6-58d6-49b9-8453-b1fad4cae299","Type":"ContainerStarted","Data":"dde7da0db87a686789409bed5f97bc919fa84397f3157bd95d9998b7cab7eb3a"} Jul 02 17:03:32.144228 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:32.144195 2535 generic.go:356] "Generic (PLEG): container finished" podID="c310c8e6-58d6-49b9-8453-b1fad4cae299" containerID="dde7da0db87a686789409bed5f97bc919fa84397f3157bd95d9998b7cab7eb3a" exitCode=0 Jul 02 17:03:32.144228 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:32.144232 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" event={"ID":"c310c8e6-58d6-49b9-8453-b1fad4cae299","Type":"ContainerDied","Data":"dde7da0db87a686789409bed5f97bc919fa84397f3157bd95d9998b7cab7eb3a"} Jul 02 17:03:33.150532 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:33.150487 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" event={"ID":"c310c8e6-58d6-49b9-8453-b1fad4cae299","Type":"ContainerStarted","Data":"08b97bb34783d1e3bd6ae63288b5fc782237073fd4f514773bb869fa2f66eb60"} Jul 02 17:03:33.150912 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:33.150587 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:33.177100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:33.177041 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" podStartSLOduration=2.577317714 podStartE2EDuration="7.177023758s" totalImagesPullingTime="3.514572315s" totalInitContainerRuntime="1.085133729s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:33.174675313 +0000 UTC m=+391.278693855" watchObservedRunningTime="2026-07-02 17:03:33.177023758 +0000 UTC m=+391.281042352" Jul 02 17:03:44.158174 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:44.158139 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7758cbfb47-hvqhx" Jul 02 17:03:45.982843 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:45.982805 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:46.103371 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.103333 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:46.529372 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.529340 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:46.658256 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.658222 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn"] Jul 02 17:03:46.663122 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.663104 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.666730 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.666703 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 17:03:46.672134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.672117 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 17:03:46.672804 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.672783 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ptgn5\"" Jul 02 17:03:46.690933 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.690905 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn"] Jul 02 17:03:46.735521 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.735490 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d10e021f-cf38-45c5-bd45-81b6b399a6ae-tmp\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.735660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.735524 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d10e021f-cf38-45c5-bd45-81b6b399a6ae-tls-certs\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.735660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.735651 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52h5\" (UniqueName: \"kubernetes.io/projected/d10e021f-cf38-45c5-bd45-81b6b399a6ae-kube-api-access-x52h5\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.836254 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.836176 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52h5\" (UniqueName: \"kubernetes.io/projected/d10e021f-cf38-45c5-bd45-81b6b399a6ae-kube-api-access-x52h5\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.836254 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.836223 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d10e021f-cf38-45c5-bd45-81b6b399a6ae-tmp\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.836418 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.836256 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d10e021f-cf38-45c5-bd45-81b6b399a6ae-tls-certs\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.838487 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.838451 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d10e021f-cf38-45c5-bd45-81b6b399a6ae-tmp\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.838672 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.838655 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d10e021f-cf38-45c5-bd45-81b6b399a6ae-tls-certs\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.854176 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.854144 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52h5\" (UniqueName: \"kubernetes.io/projected/d10e021f-cf38-45c5-bd45-81b6b399a6ae-kube-api-access-x52h5\") pod \"kube-auth-proxy-54f48b874f-hdwxn\" (UID: \"d10e021f-cf38-45c5-bd45-81b6b399a6ae\") " pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:46.858794 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.858762 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:46.972453 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:46.972420 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" Jul 02 17:03:47.005032 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.005001 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tkgqw"] Jul 02 17:03:47.007273 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.007255 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.011832 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.011807 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5w4vb\"" Jul 02 17:03:47.012243 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.012223 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 17:03:47.060632 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.060585 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:47.061392 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.061172 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tkgqw"] Jul 02 17:03:47.118085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.118058 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn"] Jul 02 17:03:47.120992 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:47.120963 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10e021f_cf38_45c5_bd45_81b6b399a6ae.slice/crio-ad310149e25e79a2636d05d067102e6bd2ff6926d111da027368b5cb4ec1910b WatchSource:0}: Error finding container ad310149e25e79a2636d05d067102e6bd2ff6926d111da027368b5cb4ec1910b: Status 404 returned error can't find the container with id ad310149e25e79a2636d05d067102e6bd2ff6926d111da027368b5cb4ec1910b Jul 02 17:03:47.138708 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.138680 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17d8d125-8d2f-45d8-9721-54136ad6db11-cert\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.138851 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.138724 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw2jt\" (UniqueName: \"kubernetes.io/projected/17d8d125-8d2f-45d8-9721-54136ad6db11-kube-api-access-cw2jt\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.147918 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.147885 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:47.211517 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.211484 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" event={"ID":"d10e021f-cf38-45c5-bd45-81b6b399a6ae","Type":"ContainerStarted","Data":"ad310149e25e79a2636d05d067102e6bd2ff6926d111da027368b5cb4ec1910b"} Jul 02 17:03:47.239723 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.239688 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw2jt\" (UniqueName: \"kubernetes.io/projected/17d8d125-8d2f-45d8-9721-54136ad6db11-kube-api-access-cw2jt\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.239886 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.239767 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17d8d125-8d2f-45d8-9721-54136ad6db11-cert\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.239886 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:03:47.239862 2535 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 17:03:47.239962 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:03:47.239919 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17d8d125-8d2f-45d8-9721-54136ad6db11-cert podName:17d8d125-8d2f-45d8-9721-54136ad6db11 nodeName:}" failed. No retries permitted until 2026-07-02 17:03:47.739901519 +0000 UTC m=+405.843920058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/17d8d125-8d2f-45d8-9721-54136ad6db11-cert") pod "odh-model-controller-7998c67dc4-tkgqw" (UID: "17d8d125-8d2f-45d8-9721-54136ad6db11") : secret "odh-model-controller-webhook-cert" not found Jul 02 17:03:47.252379 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.252343 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw2jt\" (UniqueName: \"kubernetes.io/projected/17d8d125-8d2f-45d8-9721-54136ad6db11-kube-api-access-cw2jt\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.261690 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.261648 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:47.744719 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.744675 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17d8d125-8d2f-45d8-9721-54136ad6db11-cert\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.747596 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.747569 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17d8d125-8d2f-45d8-9721-54136ad6db11-cert\") pod \"odh-model-controller-7998c67dc4-tkgqw\" (UID: \"17d8d125-8d2f-45d8-9721-54136ad6db11\") " pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:47.776880 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.776840 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:47.918043 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:47.918006 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:48.031974 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.031937 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:48.067427 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.067348 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tkgqw"] Jul 02 17:03:48.070120 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:48.070077 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d8d125_8d2f_45d8_9721_54136ad6db11.slice/crio-9d99d13974054ff7e3fa95a4ecbb3bdcd275e7ef052543fb233db08c987eac6a WatchSource:0}: Error finding container 9d99d13974054ff7e3fa95a4ecbb3bdcd275e7ef052543fb233db08c987eac6a: Status 404 returned error can't find the container with id 9d99d13974054ff7e3fa95a4ecbb3bdcd275e7ef052543fb233db08c987eac6a Jul 02 17:03:48.096373 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.096342 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hcn5t"] Jul 02 17:03:48.099520 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.099498 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.102163 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.102138 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xrhbm\"" Jul 02 17:03:48.102426 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.102400 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 17:03:48.114336 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.114276 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hcn5t"] Jul 02 17:03:48.149321 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.149279 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7wbh\" (UniqueName: \"kubernetes.io/projected/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-kube-api-access-w7wbh\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.149519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.149337 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.217384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.217348 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" event={"ID":"17d8d125-8d2f-45d8-9721-54136ad6db11","Type":"ContainerStarted","Data":"9d99d13974054ff7e3fa95a4ecbb3bdcd275e7ef052543fb233db08c987eac6a"} Jul 02 17:03:48.249986 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.249937 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7wbh\" (UniqueName: \"kubernetes.io/projected/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-kube-api-access-w7wbh\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.250176 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.250000 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.250176 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:03:48.250164 2535 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 02 17:03:48.250300 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:03:48.250261 2535 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-tls-certs podName:314271a6-5af4-4bb8-8ff7-d3be62a71a8e nodeName:}" failed. No retries permitted until 2026-07-02 17:03:48.750241845 +0000 UTC m=+406.854260378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-tls-certs") pod "model-serving-api-54d89bd5fc-hcn5t" (UID: "314271a6-5af4-4bb8-8ff7-d3be62a71a8e") : secret "model-serving-api-tls" not found Jul 02 17:03:48.263125 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.263029 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:48.274596 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.274567 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7wbh\" (UniqueName: \"kubernetes.io/projected/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-kube-api-access-w7wbh\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.350634 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.350597 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:48.462432 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.462374 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:48.753683 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.753525 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:48.756884 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:48.756846 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314271a6-5af4-4bb8-8ff7-d3be62a71a8e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hcn5t\" (UID: \"314271a6-5af4-4bb8-8ff7-d3be62a71a8e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:49.013094 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:49.012998 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:49.166301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:49.166265 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hcn5t"] Jul 02 17:03:49.169429 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:49.169399 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314271a6_5af4_4bb8_8ff7_d3be62a71a8e.slice/crio-c83bad883da2fa5e95f65bcfb870b5567807cb057148789b3c84afc028f5f3f2 WatchSource:0}: Error finding container c83bad883da2fa5e95f65bcfb870b5567807cb057148789b3c84afc028f5f3f2: Status 404 returned error can't find the container with id c83bad883da2fa5e95f65bcfb870b5567807cb057148789b3c84afc028f5f3f2 Jul 02 17:03:49.226428 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:49.226379 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" event={"ID":"314271a6-5af4-4bb8-8ff7-d3be62a71a8e","Type":"ContainerStarted","Data":"c83bad883da2fa5e95f65bcfb870b5567807cb057148789b3c84afc028f5f3f2"} Jul 02 17:03:49.352431 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:49.352288 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:52.242298 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.242257 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" event={"ID":"d10e021f-cf38-45c5-bd45-81b6b399a6ae","Type":"ContainerStarted","Data":"d9f1831c3d5527146f1c6f671cc75a88d921098e33805fa6080ca0676fef695b"} Jul 02 17:03:52.243835 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.243797 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" event={"ID":"314271a6-5af4-4bb8-8ff7-d3be62a71a8e","Type":"ContainerStarted","Data":"1fbc57bb69f9273303e0bf6f8413059e3b5c5afbe977d4ac747b74f7b9b1fefb"} Jul 02 17:03:52.243966 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.243864 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:03:52.245229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.245205 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" event={"ID":"17d8d125-8d2f-45d8-9721-54136ad6db11","Type":"ContainerStarted","Data":"7abfbc3f23539584e83e5df920d759124a0b40ebbc14996cc29ad62704739880"} Jul 02 17:03:52.245345 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.245256 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:03:52.258731 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.258680 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54f48b874f-hdwxn" podStartSLOduration=1.8680596280000001 podStartE2EDuration="6.258662417s" totalImagesPullingTime="4.390602789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:52.258264753 +0000 UTC m=+410.362283296" watchObservedRunningTime="2026-07-02 17:03:52.258662417 +0000 UTC m=+410.362680961" Jul 02 17:03:52.275118 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.275071 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" podStartSLOduration=2.80810415 podStartE2EDuration="6.275057307s" totalImagesPullingTime="3.466953157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:52.273488875 +0000 UTC m=+410.377507418" watchObservedRunningTime="2026-07-02 17:03:52.275057307 +0000 UTC m=+410.379075848" Jul 02 17:03:52.293260 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.293207 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" podStartSLOduration=1.922224723 podStartE2EDuration="4.293191344s" totalImagesPullingTime="2.370966621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:52.292621683 +0000 UTC m=+410.396640225" watchObservedRunningTime="2026-07-02 17:03:52.293191344 +0000 UTC m=+410.397209885" Jul 02 17:03:52.999337 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:52.999301 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:53.096981 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.096943 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:53.640856 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.640817 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8"] Jul 02 17:03:53.643173 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.643151 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.645968 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.645947 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lvsgn\"" Jul 02 17:03:53.646080 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.645988 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 17:03:53.661295 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.660829 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8"] Jul 02 17:03:53.685613 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.685579 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:53.698025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.697998 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxm2w\" (UniqueName: \"kubernetes.io/projected/bb10f124-6e97-457a-a8b0-d918ad184e48-kube-api-access-fxm2w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698168 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698041 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698168 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698063 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb10f124-6e97-457a-a8b0-d918ad184e48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698168 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698147 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698200 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698231 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698283 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698317 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.698492 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.698342 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.799677 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.799641 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.799879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.799700 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb10f124-6e97-457a-a8b0-d918ad184e48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.799879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.799749 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.799879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.799777 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.799879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.799805 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800115 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800086 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800196 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800139 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800266 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800233 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800321 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800305 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800371 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800310 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxm2w\" (UniqueName: \"kubernetes.io/projected/bb10f124-6e97-457a-a8b0-d918ad184e48-kube-api-access-fxm2w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800621 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800645 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800840 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800689 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.800840 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.800802 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb10f124-6e97-457a-a8b0-d918ad184e48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.802728 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.802701 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.802980 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.802944 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.808180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.808154 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb10f124-6e97-457a-a8b0-d918ad184e48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.808400 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.808381 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxm2w\" (UniqueName: \"kubernetes.io/projected/bb10f124-6e97-457a-a8b0-d918ad184e48-kube-api-access-fxm2w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qt7t8\" (UID: \"bb10f124-6e97-457a-a8b0-d918ad184e48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:53.827780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.827750 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:53.922322 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.922238 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:53.955166 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:53.955130 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:54.118500 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:54.118476 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8"] Jul 02 17:03:54.120343 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:54.120308 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb10f124_6e97_457a_a8b0_d918ad184e48.slice/crio-1402df1299d3339e10e6fbc58f0484831527dfbeb145c9edfff877575789b390 WatchSource:0}: Error finding container 1402df1299d3339e10e6fbc58f0484831527dfbeb145c9edfff877575789b390: Status 404 returned error can't find the container with id 1402df1299d3339e10e6fbc58f0484831527dfbeb145c9edfff877575789b390 Jul 02 17:03:54.254468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:54.254435 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" event={"ID":"bb10f124-6e97-457a-a8b0-d918ad184e48","Type":"ContainerStarted","Data":"1402df1299d3339e10e6fbc58f0484831527dfbeb145c9edfff877575789b390"} Jul 02 17:03:56.112647 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.112615 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd"] Jul 02 17:03:56.118198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.118170 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.128329 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.128305 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 17:03:56.129246 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.129225 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pm8cc\"" Jul 02 17:03:56.129339 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.129248 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 17:03:56.129339 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.129318 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 17:03:56.153645 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.153602 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd"] Jul 02 17:03:56.225370 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.225332 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-manager-config\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.225574 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.225428 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-metrics-cert\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.225574 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.225502 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-cert\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.225664 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.225590 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2f9\" (UniqueName: \"kubernetes.io/projected/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-kube-api-access-dl2f9\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.326384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.326354 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-cert\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.326582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.326405 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2f9\" (UniqueName: \"kubernetes.io/projected/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-kube-api-access-dl2f9\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.326582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.326461 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-manager-config\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.326582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.326498 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-metrics-cert\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.327286 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.327255 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-manager-config\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.329133 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.329114 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-cert\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.329241 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.329154 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-metrics-cert\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.342143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.342116 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2f9\" (UniqueName: \"kubernetes.io/projected/c45dd8a5-49d0-4d67-a718-e9f314ff6af1-kube-api-access-dl2f9\") pod \"lws-controller-manager-79ccbb9b6f-gghjd\" (UID: \"c45dd8a5-49d0-4d67-a718-e9f314ff6af1\") " pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.429489 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.429406 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:56.591735 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.591275 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:03:56.591735 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.591379 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:03:56.591735 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.591436 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:03:56.691897 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:56.691861 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd"] Jul 02 17:03:56.694191 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:03:56.694161 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45dd8a5_49d0_4d67_a718_e9f314ff6af1.slice/crio-f53f583f92607a7f22b328a3532fc61f9fc37a5f402b25ec6c045e05b5159bdc WatchSource:0}: Error finding container f53f583f92607a7f22b328a3532fc61f9fc37a5f402b25ec6c045e05b5159bdc: Status 404 returned error can't find the container with id f53f583f92607a7f22b328a3532fc61f9fc37a5f402b25ec6c045e05b5159bdc Jul 02 17:03:57.272878 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:57.272835 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" event={"ID":"bb10f124-6e97-457a-a8b0-d918ad184e48","Type":"ContainerStarted","Data":"7e4bee50182a973fd59fb4218af4428dbb921d04ec3936e6064a47992ad34ade"} Jul 02 17:03:57.274113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:57.274082 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" event={"ID":"c45dd8a5-49d0-4d67-a718-e9f314ff6af1","Type":"ContainerStarted","Data":"f53f583f92607a7f22b328a3532fc61f9fc37a5f402b25ec6c045e05b5159bdc"} Jul 02 17:03:57.396994 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:57.396934 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" podStartSLOduration=1.928560083 podStartE2EDuration="4.396906772s" totalImagesPullingTime="2.468346689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:57.394491229 +0000 UTC m=+415.498509787" watchObservedRunningTime="2026-07-02 17:03:57.396906772 +0000 UTC m=+415.500925331" Jul 02 17:03:57.956156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:57.956133 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:57.960756 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:57.960731 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:58.283015 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:58.282974 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" event={"ID":"c45dd8a5-49d0-4d67-a718-e9f314ff6af1","Type":"ContainerStarted","Data":"ccb93bdd6f7ae2f286a8ebd9f7cfb3ae5f6ec6b10c8a897ac064d4783b61f88f"} Jul 02 17:03:58.283511 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:58.283148 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:03:58.283511 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:58.283194 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:58.284156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:58.284139 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qt7t8" Jul 02 17:03:58.329827 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:58.329768 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" podStartSLOduration=1.135964182 podStartE2EDuration="2.329749668s" totalImagesPullingTime="1.193785486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:58.327988012 +0000 UTC m=+416.432006553" watchObservedRunningTime="2026-07-02 17:03:58.329749668 +0000 UTC m=+416.433768213" Jul 02 17:03:59.112323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:59.112270 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:59.287403 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:59.287371 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:59.615726 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:59.615684 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:59.772937 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:59.772887 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:03:59.904903 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:03:59.904811 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:03.250745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:03.250716 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tkgqw" Jul 02 17:04:03.253981 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:03.253960 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hcn5t" Jul 02 17:04:09.290402 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:09.290365 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79ccbb9b6f-gghjd" Jul 02 17:04:47.696034 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:47.695981 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:47.790607 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:47.790568 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:47.868257 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:47.868223 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:48.384639 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:48.384596 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:48.617902 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:48.617874 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:48.878291 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:48.878253 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:49.507379 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:49.507343 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:04:49.571140 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:04:49.571107 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:03.227016 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.226975 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c"] Jul 02 17:05:03.229494 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.229476 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.232849 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.232626 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 17:05:03.232849 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.232793 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v6mf2\"" Jul 02 17:05:03.233721 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.233342 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 17:05:03.238628 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.238594 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c"] Jul 02 17:05:03.391400 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.391345 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.391616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.391456 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxfq\" (UniqueName: \"kubernetes.io/projected/3fa91561-81dd-4add-82c8-dcd3a6555c9b-kube-api-access-tkxfq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.391616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.391535 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.492745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.492643 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.492745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.492735 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.492948 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.492765 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxfq\" (UniqueName: \"kubernetes.io/projected/3fa91561-81dd-4add-82c8-dcd3a6555c9b-kube-api-access-tkxfq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.493054 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.493034 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.493091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.493059 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.501629 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.501595 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxfq\" (UniqueName: \"kubernetes.io/projected/3fa91561-81dd-4add-82c8-dcd3a6555c9b-kube-api-access-tkxfq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.544516 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.544487 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:03.673587 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.673554 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c"] Jul 02 17:05:03.676063 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:05:03.676032 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa91561_81dd_4add_82c8_dcd3a6555c9b.slice/crio-36df6becf5581d2379ad13891a11a59233d74f55db0cc63bcbc18aa4e2d55bed WatchSource:0}: Error finding container 36df6becf5581d2379ad13891a11a59233d74f55db0cc63bcbc18aa4e2d55bed: Status 404 returned error can't find the container with id 36df6becf5581d2379ad13891a11a59233d74f55db0cc63bcbc18aa4e2d55bed Jul 02 17:05:03.829484 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.829448 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7"] Jul 02 17:05:03.832023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.831999 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:03.845398 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.845367 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7"] Jul 02 17:05:03.998042 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.998010 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtqs6\" (UniqueName: \"kubernetes.io/projected/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-kube-api-access-gtqs6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:03.998042 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.998045 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:03.998268 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:03.998102 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.099413 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.099316 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtqs6\" (UniqueName: \"kubernetes.io/projected/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-kube-api-access-gtqs6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.099413 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.099359 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.099413 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.099401 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.099792 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.099772 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.099839 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.099817 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.108166 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.108141 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtqs6\" (UniqueName: \"kubernetes.io/projected/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-kube-api-access-gtqs6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.142147 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.142123 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:04.228780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.228748 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr"] Jul 02 17:05:04.232217 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.232190 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.244742 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.244717 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr"] Jul 02 17:05:04.277506 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.277479 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7"] Jul 02 17:05:04.279838 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:05:04.279813 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c1b4d4_5774_42c8_bf81_7b7968dc0eb5.slice/crio-3aa5e1bbff1115306fa060ea809ec134f0b4024611053973967cf18762d89130 WatchSource:0}: Error finding container 3aa5e1bbff1115306fa060ea809ec134f0b4024611053973967cf18762d89130: Status 404 returned error can't find the container with id 3aa5e1bbff1115306fa060ea809ec134f0b4024611053973967cf18762d89130 Jul 02 17:05:04.402090 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.402064 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.402221 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.402107 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.402221 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.402203 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn24h\" (UniqueName: \"kubernetes.io/projected/8d87144f-edeb-495a-9a01-10e9da1946c2-kube-api-access-kn24h\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.503170 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.503132 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.503348 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.503187 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn24h\" (UniqueName: \"kubernetes.io/projected/8d87144f-edeb-495a-9a01-10e9da1946c2-kube-api-access-kn24h\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.503348 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.503247 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.503597 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.503529 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.503720 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.503655 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.512235 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.512211 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn24h\" (UniqueName: \"kubernetes.io/projected/8d87144f-edeb-495a-9a01-10e9da1946c2-kube-api-access-kn24h\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.545039 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.545019 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:04.573168 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.573136 2535 generic.go:356] "Generic (PLEG): container finished" podID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerID="62416a80719ac0b8c4fcaa31c7cec3bcb2f46019a4272ee1869a8c61b4a42778" exitCode=0 Jul 02 17:05:04.573312 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.573218 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" event={"ID":"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5","Type":"ContainerDied","Data":"62416a80719ac0b8c4fcaa31c7cec3bcb2f46019a4272ee1869a8c61b4a42778"} Jul 02 17:05:04.573312 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.573274 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" event={"ID":"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5","Type":"ContainerStarted","Data":"3aa5e1bbff1115306fa060ea809ec134f0b4024611053973967cf18762d89130"} Jul 02 17:05:04.575101 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.575062 2535 generic.go:356] "Generic (PLEG): container finished" podID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerID="74fc2a6dfd8998e9cef59a75d005e4fd0de677271a8565df278b9c4fcd6d67e8" exitCode=0 Jul 02 17:05:04.575204 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.575147 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" event={"ID":"3fa91561-81dd-4add-82c8-dcd3a6555c9b","Type":"ContainerDied","Data":"74fc2a6dfd8998e9cef59a75d005e4fd0de677271a8565df278b9c4fcd6d67e8"} Jul 02 17:05:04.575253 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.575198 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" event={"ID":"3fa91561-81dd-4add-82c8-dcd3a6555c9b","Type":"ContainerStarted","Data":"36df6becf5581d2379ad13891a11a59233d74f55db0cc63bcbc18aa4e2d55bed"} Jul 02 17:05:04.632671 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.632641 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b"] Jul 02 17:05:04.636624 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.636601 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.646180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.646152 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b"] Jul 02 17:05:04.683115 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.683062 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr"] Jul 02 17:05:04.685172 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:05:04.685149 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d87144f_edeb_495a_9a01_10e9da1946c2.slice/crio-29035a3543df9a60ca6f76071dd8081dd228c70db364eb1d73f62a75c22d3e39 WatchSource:0}: Error finding container 29035a3543df9a60ca6f76071dd8081dd228c70db364eb1d73f62a75c22d3e39: Status 404 returned error can't find the container with id 29035a3543df9a60ca6f76071dd8081dd228c70db364eb1d73f62a75c22d3e39 Jul 02 17:05:04.807684 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.807654 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g7q8\" (UniqueName: \"kubernetes.io/projected/58cc2e0e-dc87-4458-afea-8a4992ce3125-kube-api-access-6g7q8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.807801 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.807694 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.807801 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.807771 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.909228 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.909144 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.909228 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.909225 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g7q8\" (UniqueName: \"kubernetes.io/projected/58cc2e0e-dc87-4458-afea-8a4992ce3125-kube-api-access-6g7q8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.909402 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.909245 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.909533 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.909511 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.909604 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.909569 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.920828 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.918346 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g7q8\" (UniqueName: \"kubernetes.io/projected/58cc2e0e-dc87-4458-afea-8a4992ce3125-kube-api-access-6g7q8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:04.948373 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:04.948329 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:05.081276 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.081250 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b"] Jul 02 17:05:05.083069 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:05:05.083042 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cc2e0e_dc87_4458_afea_8a4992ce3125.slice/crio-47101b2067061f157e4110101e62886ca113e9399f8c0d60ff6384bb34598858 WatchSource:0}: Error finding container 47101b2067061f157e4110101e62886ca113e9399f8c0d60ff6384bb34598858: Status 404 returned error can't find the container with id 47101b2067061f157e4110101e62886ca113e9399f8c0d60ff6384bb34598858 Jul 02 17:05:05.581270 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.581233 2535 generic.go:356] "Generic (PLEG): container finished" podID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerID="30bfeac206c8fd99e562340e48859917802f214ba31bfc98acdc207d6ef5b110" exitCode=0 Jul 02 17:05:05.581698 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.581314 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" event={"ID":"8d87144f-edeb-495a-9a01-10e9da1946c2","Type":"ContainerDied","Data":"30bfeac206c8fd99e562340e48859917802f214ba31bfc98acdc207d6ef5b110"} Jul 02 17:05:05.581698 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.581361 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" event={"ID":"8d87144f-edeb-495a-9a01-10e9da1946c2","Type":"ContainerStarted","Data":"29035a3543df9a60ca6f76071dd8081dd228c70db364eb1d73f62a75c22d3e39"} Jul 02 17:05:05.583242 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.583212 2535 generic.go:356] "Generic (PLEG): container finished" podID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerID="e5fdfc38974baf408bc08732baf3b2865eba1388095674512d098481a53a3259" exitCode=0 Jul 02 17:05:05.583359 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.583292 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" event={"ID":"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5","Type":"ContainerDied","Data":"e5fdfc38974baf408bc08732baf3b2865eba1388095674512d098481a53a3259"} Jul 02 17:05:05.584989 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.584961 2535 generic.go:356] "Generic (PLEG): container finished" podID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerID="190e25beff4c06af529c35506f573b8f6cac6d80fe85a275dc9ceaee24d79b08" exitCode=0 Jul 02 17:05:05.585085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.585045 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" event={"ID":"58cc2e0e-dc87-4458-afea-8a4992ce3125","Type":"ContainerDied","Data":"190e25beff4c06af529c35506f573b8f6cac6d80fe85a275dc9ceaee24d79b08"} Jul 02 17:05:05.585153 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.585089 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" event={"ID":"58cc2e0e-dc87-4458-afea-8a4992ce3125","Type":"ContainerStarted","Data":"47101b2067061f157e4110101e62886ca113e9399f8c0d60ff6384bb34598858"} Jul 02 17:05:05.587033 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.586987 2535 generic.go:356] "Generic (PLEG): container finished" podID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerID="4974ab39b45af448640f0de9f1e534d5a64212d52535c298f6f55d320b0dcf5d" exitCode=0 Jul 02 17:05:05.587114 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:05.587041 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" event={"ID":"3fa91561-81dd-4add-82c8-dcd3a6555c9b","Type":"ContainerDied","Data":"4974ab39b45af448640f0de9f1e534d5a64212d52535c298f6f55d320b0dcf5d"} Jul 02 17:05:06.594104 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.594062 2535 generic.go:356] "Generic (PLEG): container finished" podID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerID="099cd4ddf7ff13d6ed0a51fc532a163426b6b51ba499049066916cc906c37c70" exitCode=0 Jul 02 17:05:06.594564 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.594148 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" event={"ID":"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5","Type":"ContainerDied","Data":"099cd4ddf7ff13d6ed0a51fc532a163426b6b51ba499049066916cc906c37c70"} Jul 02 17:05:06.595863 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.595834 2535 generic.go:356] "Generic (PLEG): container finished" podID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerID="caaac08b8ea8ca4b51b95995e8db09ca62c57f2cebc4ae94721c1e95b9ef5bce" exitCode=0 Jul 02 17:05:06.595987 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.595913 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" event={"ID":"58cc2e0e-dc87-4458-afea-8a4992ce3125","Type":"ContainerDied","Data":"caaac08b8ea8ca4b51b95995e8db09ca62c57f2cebc4ae94721c1e95b9ef5bce"} Jul 02 17:05:06.598013 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.597987 2535 generic.go:356] "Generic (PLEG): container finished" podID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerID="f884461e7e4e4c48c8484212a479aef3356f6c6170556b8250eccfcaf3c6eec6" exitCode=0 Jul 02 17:05:06.598105 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.598080 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" event={"ID":"3fa91561-81dd-4add-82c8-dcd3a6555c9b","Type":"ContainerDied","Data":"f884461e7e4e4c48c8484212a479aef3356f6c6170556b8250eccfcaf3c6eec6"} Jul 02 17:05:06.599830 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.599810 2535 generic.go:356] "Generic (PLEG): container finished" podID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerID="d42e6c184654f957cf272e473c8ae1904ee5fe7ca50d7d86f13d11ba4de75851" exitCode=0 Jul 02 17:05:06.599941 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:06.599855 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" event={"ID":"8d87144f-edeb-495a-9a01-10e9da1946c2","Type":"ContainerDied","Data":"d42e6c184654f957cf272e473c8ae1904ee5fe7ca50d7d86f13d11ba4de75851"} Jul 02 17:05:07.606615 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.606578 2535 generic.go:356] "Generic (PLEG): container finished" podID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerID="726b851879ccf99f6561113cf2737d988611e4d378ee1092adcfac6fb5dd7182" exitCode=0 Jul 02 17:05:07.606968 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.606672 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" event={"ID":"58cc2e0e-dc87-4458-afea-8a4992ce3125","Type":"ContainerDied","Data":"726b851879ccf99f6561113cf2737d988611e4d378ee1092adcfac6fb5dd7182"} Jul 02 17:05:07.608656 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.608630 2535 generic.go:356] "Generic (PLEG): container finished" podID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerID="0965eb7fa07d4377fde1249542a5da19e43b69b25be1f0bb088794b404a63aff" exitCode=0 Jul 02 17:05:07.608770 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.608711 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" event={"ID":"8d87144f-edeb-495a-9a01-10e9da1946c2","Type":"ContainerDied","Data":"0965eb7fa07d4377fde1249542a5da19e43b69b25be1f0bb088794b404a63aff"} Jul 02 17:05:07.768864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.768843 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:07.772032 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.772010 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:07.935024 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.934947 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-util\") pod \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " Jul 02 17:05:07.935024 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.934994 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkxfq\" (UniqueName: \"kubernetes.io/projected/3fa91561-81dd-4add-82c8-dcd3a6555c9b-kube-api-access-tkxfq\") pod \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " Jul 02 17:05:07.935024 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.935016 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-util\") pod \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " Jul 02 17:05:07.935241 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.935032 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-bundle\") pod \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " Jul 02 17:05:07.935241 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.935068 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtqs6\" (UniqueName: \"kubernetes.io/projected/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-kube-api-access-gtqs6\") pod \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\" (UID: \"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5\") " Jul 02 17:05:07.935241 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.935153 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-bundle\") pod \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\" (UID: \"3fa91561-81dd-4add-82c8-dcd3a6555c9b\") " Jul 02 17:05:07.935644 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.935608 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-bundle" (OuterVolumeSpecName: "bundle") pod "51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" (UID: "51c1b4d4-5774-42c8-bf81-7b7968dc0eb5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:07.935818 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.935787 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-bundle" (OuterVolumeSpecName: "bundle") pod "3fa91561-81dd-4add-82c8-dcd3a6555c9b" (UID: "3fa91561-81dd-4add-82c8-dcd3a6555c9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:07.937339 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.937314 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa91561-81dd-4add-82c8-dcd3a6555c9b-kube-api-access-tkxfq" (OuterVolumeSpecName: "kube-api-access-tkxfq") pod "3fa91561-81dd-4add-82c8-dcd3a6555c9b" (UID: "3fa91561-81dd-4add-82c8-dcd3a6555c9b"). InnerVolumeSpecName "kube-api-access-tkxfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:05:07.937424 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.937350 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-kube-api-access-gtqs6" (OuterVolumeSpecName: "kube-api-access-gtqs6") pod "51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" (UID: "51c1b4d4-5774-42c8-bf81-7b7968dc0eb5"). InnerVolumeSpecName "kube-api-access-gtqs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:05:07.943323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.943287 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-util" (OuterVolumeSpecName: "util") pod "51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" (UID: "51c1b4d4-5774-42c8-bf81-7b7968dc0eb5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:07.944421 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:07.944398 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-util" (OuterVolumeSpecName: "util") pod "3fa91561-81dd-4add-82c8-dcd3a6555c9b" (UID: "3fa91561-81dd-4add-82c8-dcd3a6555c9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:08.036529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.036488 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtqs6\" (UniqueName: \"kubernetes.io/projected/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-kube-api-access-gtqs6\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:08.036529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.036523 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:08.036529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.036561 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:08.036794 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.036576 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkxfq\" (UniqueName: \"kubernetes.io/projected/3fa91561-81dd-4add-82c8-dcd3a6555c9b-kube-api-access-tkxfq\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:08.036794 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.036588 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa91561-81dd-4add-82c8-dcd3a6555c9b-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:08.036794 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.036599 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c1b4d4-5774-42c8-bf81-7b7968dc0eb5-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:08.615256 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.615228 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" Jul 02 17:05:08.615740 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.615268 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c" event={"ID":"3fa91561-81dd-4add-82c8-dcd3a6555c9b","Type":"ContainerDied","Data":"36df6becf5581d2379ad13891a11a59233d74f55db0cc63bcbc18aa4e2d55bed"} Jul 02 17:05:08.615740 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.615319 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36df6becf5581d2379ad13891a11a59233d74f55db0cc63bcbc18aa4e2d55bed" Jul 02 17:05:08.617455 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.617428 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" event={"ID":"51c1b4d4-5774-42c8-bf81-7b7968dc0eb5","Type":"ContainerDied","Data":"3aa5e1bbff1115306fa060ea809ec134f0b4024611053973967cf18762d89130"} Jul 02 17:05:08.617576 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.617471 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aa5e1bbff1115306fa060ea809ec134f0b4024611053973967cf18762d89130" Jul 02 17:05:08.617576 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.617473 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7" Jul 02 17:05:08.789454 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.789432 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:08.791505 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.791488 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:08.944527 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.944435 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn24h\" (UniqueName: \"kubernetes.io/projected/8d87144f-edeb-495a-9a01-10e9da1946c2-kube-api-access-kn24h\") pod \"8d87144f-edeb-495a-9a01-10e9da1946c2\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " Jul 02 17:05:08.944527 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.944500 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-bundle\") pod \"8d87144f-edeb-495a-9a01-10e9da1946c2\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " Jul 02 17:05:08.944790 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.944533 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-util\") pod \"58cc2e0e-dc87-4458-afea-8a4992ce3125\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " Jul 02 17:05:08.944790 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.944581 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-bundle\") pod \"58cc2e0e-dc87-4458-afea-8a4992ce3125\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " Jul 02 17:05:08.944790 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.944603 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-util\") pod \"8d87144f-edeb-495a-9a01-10e9da1946c2\" (UID: \"8d87144f-edeb-495a-9a01-10e9da1946c2\") " Jul 02 17:05:08.944790 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.944650 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g7q8\" (UniqueName: \"kubernetes.io/projected/58cc2e0e-dc87-4458-afea-8a4992ce3125-kube-api-access-6g7q8\") pod \"58cc2e0e-dc87-4458-afea-8a4992ce3125\" (UID: \"58cc2e0e-dc87-4458-afea-8a4992ce3125\") " Jul 02 17:05:08.945252 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.945207 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-bundle" (OuterVolumeSpecName: "bundle") pod "8d87144f-edeb-495a-9a01-10e9da1946c2" (UID: "8d87144f-edeb-495a-9a01-10e9da1946c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:08.945381 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.945255 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-bundle" (OuterVolumeSpecName: "bundle") pod "58cc2e0e-dc87-4458-afea-8a4992ce3125" (UID: "58cc2e0e-dc87-4458-afea-8a4992ce3125"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:08.946660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.946638 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d87144f-edeb-495a-9a01-10e9da1946c2-kube-api-access-kn24h" (OuterVolumeSpecName: "kube-api-access-kn24h") pod "8d87144f-edeb-495a-9a01-10e9da1946c2" (UID: "8d87144f-edeb-495a-9a01-10e9da1946c2"). InnerVolumeSpecName "kube-api-access-kn24h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:05:08.946855 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.946831 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cc2e0e-dc87-4458-afea-8a4992ce3125-kube-api-access-6g7q8" (OuterVolumeSpecName: "kube-api-access-6g7q8") pod "58cc2e0e-dc87-4458-afea-8a4992ce3125" (UID: "58cc2e0e-dc87-4458-afea-8a4992ce3125"). InnerVolumeSpecName "kube-api-access-6g7q8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:05:08.952682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.952605 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-util" (OuterVolumeSpecName: "util") pod "58cc2e0e-dc87-4458-afea-8a4992ce3125" (UID: "58cc2e0e-dc87-4458-afea-8a4992ce3125"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:08.952926 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:08.952899 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-util" (OuterVolumeSpecName: "util") pod "8d87144f-edeb-495a-9a01-10e9da1946c2" (UID: "8d87144f-edeb-495a-9a01-10e9da1946c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:05:09.046092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.046057 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:09.046092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.046088 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58cc2e0e-dc87-4458-afea-8a4992ce3125-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:09.046092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.046097 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:09.046326 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.046107 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g7q8\" (UniqueName: \"kubernetes.io/projected/58cc2e0e-dc87-4458-afea-8a4992ce3125-kube-api-access-6g7q8\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:09.046326 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.046117 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn24h\" (UniqueName: \"kubernetes.io/projected/8d87144f-edeb-495a-9a01-10e9da1946c2-kube-api-access-kn24h\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:09.046326 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.046126 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d87144f-edeb-495a-9a01-10e9da1946c2-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:05:09.624324 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.624294 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" Jul 02 17:05:09.624745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.624320 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b" event={"ID":"58cc2e0e-dc87-4458-afea-8a4992ce3125","Type":"ContainerDied","Data":"47101b2067061f157e4110101e62886ca113e9399f8c0d60ff6384bb34598858"} Jul 02 17:05:09.624745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.624369 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47101b2067061f157e4110101e62886ca113e9399f8c0d60ff6384bb34598858" Jul 02 17:05:09.626241 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.626220 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" event={"ID":"8d87144f-edeb-495a-9a01-10e9da1946c2","Type":"ContainerDied","Data":"29035a3543df9a60ca6f76071dd8081dd228c70db364eb1d73f62a75c22d3e39"} Jul 02 17:05:09.626377 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.626257 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29035a3543df9a60ca6f76071dd8081dd228c70db364eb1d73f62a75c22d3e39" Jul 02 17:05:09.626377 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:09.626228 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr" Jul 02 17:05:10.703935 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:10.703900 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:11.317478 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:11.317436 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:12.401496 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:12.401456 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:15.190923 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:15.190887 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:15.310486 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:15.310453 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:15.431725 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:15.431688 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:18.541135 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:18.541096 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:19.269946 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:19.269904 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:20.813945 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:20.813913 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:21.382529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:21.382496 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:23.962143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:23.962111 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:24.095825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:24.095793 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:24.409198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:24.409107 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:24.567431 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:24.567386 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:26.287005 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:26.286968 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:26.423755 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:26.423725 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:26.545362 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:26.545273 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:26.797549 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:26.797457 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:26.880696 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:26.880648 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:29.636067 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:29.636030 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:29.796246 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:29.796210 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:35.710721 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:35.710686 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:35.847134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:35.847094 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:38.116994 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:38.116954 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:38.230311 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:38.230269 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:39.083624 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:39.083588 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:42.939098 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:42.939057 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:43.089934 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:43.089897 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:48.127103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:48.127040 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:48.278402 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:48.278368 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:54.248897 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:54.248818 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:54.616296 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:54.616197 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:56.713519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:56.713470 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:05:56.821406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:05:56.821371 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:10.538863 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:10.538812 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:10.681782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:10.681744 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:14.712332 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:14.712282 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:14.817876 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:14.817844 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:15.376175 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:15.376136 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:15.489880 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:15.489845 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:15.564582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:15.564532 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:16.263984 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.263941 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9b9d2"] Jul 02 17:06:16.264452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264393 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="util" Jul 02 17:06:16.264452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264412 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="util" Jul 02 17:06:16.264452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264427 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="extract" Jul 02 17:06:16.264452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264435 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="extract" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264457 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264466 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264476 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264484 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264500 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="util" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264508 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="util" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264518 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264526 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264557 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="extract" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264566 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="extract" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264577 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264585 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="pull" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264597 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="util" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264605 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="util" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264613 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="extract" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264621 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="extract" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264633 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="util" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264641 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="util" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264650 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="extract" Jul 02 17:06:16.264707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264658 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="extract" Jul 02 17:06:16.265682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264754 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cc2e0e-dc87-4458-afea-8a4992ce3125" containerName="extract" Jul 02 17:06:16.265682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264769 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c1b4d4-5774-42c8-bf81-7b7968dc0eb5" containerName="extract" Jul 02 17:06:16.265682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264778 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d87144f-edeb-495a-9a01-10e9da1946c2" containerName="extract" Jul 02 17:06:16.265682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.264789 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa91561-81dd-4add-82c8-dcd3a6555c9b" containerName="extract" Jul 02 17:06:16.268092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.268071 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:16.270584 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.270566 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 17:06:16.271138 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.271121 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mgwv2\"" Jul 02 17:06:16.271138 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.271134 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 17:06:16.275032 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.275011 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b9d2"] Jul 02 17:06:16.303148 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.303117 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wb69\" (UniqueName: \"kubernetes.io/projected/77707d2d-cbc1-4f32-b214-f094ed074bc6-kube-api-access-6wb69\") pod \"authorino-58cd955675-9b9d2\" (UID: \"77707d2d-cbc1-4f32-b214-f094ed074bc6\") " pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:16.313653 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.313623 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:16.404428 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.404392 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb69\" (UniqueName: \"kubernetes.io/projected/77707d2d-cbc1-4f32-b214-f094ed074bc6-kube-api-access-6wb69\") pod \"authorino-58cd955675-9b9d2\" (UID: \"77707d2d-cbc1-4f32-b214-f094ed074bc6\") " pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:16.421825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.421796 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wb69\" (UniqueName: \"kubernetes.io/projected/77707d2d-cbc1-4f32-b214-f094ed074bc6-kube-api-access-6wb69\") pod \"authorino-58cd955675-9b9d2\" (UID: \"77707d2d-cbc1-4f32-b214-f094ed074bc6\") " pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:16.436331 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.436305 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:16.577735 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.577652 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:16.610527 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.610498 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7zcnt"] Jul 02 17:06:16.614050 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.614030 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:06:16.639259 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.639062 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7zcnt"] Jul 02 17:06:16.707890 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.707858 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzttm\" (UniqueName: \"kubernetes.io/projected/fff63adf-67ba-4630-85b7-9aff245564dd-kube-api-access-nzttm\") pod \"authorino-75d556bd77-7zcnt\" (UID: \"fff63adf-67ba-4630-85b7-9aff245564dd\") " pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:06:16.736410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.736390 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b9d2"] Jul 02 17:06:16.809025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.808995 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzttm\" (UniqueName: \"kubernetes.io/projected/fff63adf-67ba-4630-85b7-9aff245564dd-kube-api-access-nzttm\") pod \"authorino-75d556bd77-7zcnt\" (UID: \"fff63adf-67ba-4630-85b7-9aff245564dd\") " pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:06:16.817520 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.817497 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzttm\" (UniqueName: \"kubernetes.io/projected/fff63adf-67ba-4630-85b7-9aff245564dd-kube-api-access-nzttm\") pod \"authorino-75d556bd77-7zcnt\" (UID: \"fff63adf-67ba-4630-85b7-9aff245564dd\") " pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:06:16.925036 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.924958 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:06:16.956033 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:16.955999 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b9d2" event={"ID":"77707d2d-cbc1-4f32-b214-f094ed074bc6","Type":"ContainerStarted","Data":"3bed223f62db741ba1628797014ac12e3f7253c7e43c247925d6d9c86869c0fc"} Jul 02 17:06:17.054671 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:17.054647 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7zcnt"] Jul 02 17:06:17.057165 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:06:17.057138 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfff63adf_67ba_4630_85b7_9aff245564dd.slice/crio-3f58734b68f64df0c2cabcff3c14ee9e27412a687a40be8c635276217dc739c9 WatchSource:0}: Error finding container 3f58734b68f64df0c2cabcff3c14ee9e27412a687a40be8c635276217dc739c9: Status 404 returned error can't find the container with id 3f58734b68f64df0c2cabcff3c14ee9e27412a687a40be8c635276217dc739c9 Jul 02 17:06:17.977489 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:17.977445 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7zcnt" event={"ID":"fff63adf-67ba-4630-85b7-9aff245564dd","Type":"ContainerStarted","Data":"3f58734b68f64df0c2cabcff3c14ee9e27412a687a40be8c635276217dc739c9"} Jul 02 17:06:20.994755 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:20.994709 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b9d2" event={"ID":"77707d2d-cbc1-4f32-b214-f094ed074bc6","Type":"ContainerStarted","Data":"e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b"} Jul 02 17:06:20.996178 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:20.996153 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7zcnt" event={"ID":"fff63adf-67ba-4630-85b7-9aff245564dd","Type":"ContainerStarted","Data":"5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814"} Jul 02 17:06:21.010156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:21.010110 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9b9d2" podStartSLOduration=1.7526937280000001 podStartE2EDuration="5.010094402s" totalImagesPullingTime="3.257400674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:21.008802811 +0000 UTC m=+559.112821354" watchObservedRunningTime="2026-07-02 17:06:21.010094402 +0000 UTC m=+559.114112944" Jul 02 17:06:21.025625 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:21.025571 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7zcnt" podStartSLOduration=2.074028033 podStartE2EDuration="5.025533299s" totalImagesPullingTime="2.951505266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:21.022767771 +0000 UTC m=+559.126786314" watchObservedRunningTime="2026-07-02 17:06:21.025533299 +0000 UTC m=+559.129551843" Jul 02 17:06:21.060173 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:21.060142 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b9d2"] Jul 02 17:06:23.006618 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:23.006576 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9b9d2" podUID="77707d2d-cbc1-4f32-b214-f094ed074bc6" containerName="authorino" containerID="cri-o://e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b" gracePeriod=30 Jul 02 17:06:23.248248 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:23.248226 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:23.264759 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:23.264664 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wb69\" (UniqueName: \"kubernetes.io/projected/77707d2d-cbc1-4f32-b214-f094ed074bc6-kube-api-access-6wb69\") pod \"77707d2d-cbc1-4f32-b214-f094ed074bc6\" (UID: \"77707d2d-cbc1-4f32-b214-f094ed074bc6\") " Jul 02 17:06:23.266842 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:23.266812 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77707d2d-cbc1-4f32-b214-f094ed074bc6-kube-api-access-6wb69" (OuterVolumeSpecName: "kube-api-access-6wb69") pod "77707d2d-cbc1-4f32-b214-f094ed074bc6" (UID: "77707d2d-cbc1-4f32-b214-f094ed074bc6"). InnerVolumeSpecName "kube-api-access-6wb69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:06:23.366110 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:23.366076 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wb69\" (UniqueName: \"kubernetes.io/projected/77707d2d-cbc1-4f32-b214-f094ed074bc6-kube-api-access-6wb69\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:06:24.012712 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.012676 2535 generic.go:356] "Generic (PLEG): container finished" podID="77707d2d-cbc1-4f32-b214-f094ed074bc6" containerID="e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b" exitCode=0 Jul 02 17:06:24.013154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.012726 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9b9d2" Jul 02 17:06:24.013154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.012754 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b9d2" event={"ID":"77707d2d-cbc1-4f32-b214-f094ed074bc6","Type":"ContainerDied","Data":"e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b"} Jul 02 17:06:24.013154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.012794 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9b9d2" event={"ID":"77707d2d-cbc1-4f32-b214-f094ed074bc6","Type":"ContainerDied","Data":"3bed223f62db741ba1628797014ac12e3f7253c7e43c247925d6d9c86869c0fc"} Jul 02 17:06:24.013154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.012811 2535 scope.go:117] "RemoveContainer" containerID="e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b" Jul 02 17:06:24.021715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.021700 2535 scope.go:117] "RemoveContainer" containerID="e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b" Jul 02 17:06:24.021979 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:06:24.021958 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b\": container with ID starting with e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b not found: ID does not exist" containerID="e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b" Jul 02 17:06:24.022028 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.021988 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b"} err="failed to get container status \"e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b\": rpc error: code = NotFound desc = could not find container \"e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b\": container with ID starting with e95c30093ca7e04d49da8c8c491d04054acde2cc05432e7eecb5539d3931d87b not found: ID does not exist" Jul 02 17:06:24.035928 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.035908 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b9d2"] Jul 02 17:06:24.043052 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.043028 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9b9d2"] Jul 02 17:06:24.388905 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:24.388826 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77707d2d-cbc1-4f32-b214-f094ed074bc6" path="/var/lib/kubelet/pods/77707d2d-cbc1-4f32-b214-f094ed074bc6/volumes" Jul 02 17:06:36.984193 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:36.984157 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:49.534962 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:49.534922 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:49.625427 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:49.625394 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:49.778637 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:49.778603 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:06:51.102385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.102350 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv"] Jul 02 17:06:51.102864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.102838 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77707d2d-cbc1-4f32-b214-f094ed074bc6" containerName="authorino" Jul 02 17:06:51.102864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.102857 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="77707d2d-cbc1-4f32-b214-f094ed074bc6" containerName="authorino" Jul 02 17:06:51.102980 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.102954 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="77707d2d-cbc1-4f32-b214-f094ed074bc6" containerName="authorino" Jul 02 17:06:51.106180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.106161 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.108721 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.108703 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4fps8\"" Jul 02 17:06:51.108992 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.108978 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 17:06:51.109646 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.109631 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 17:06:51.117502 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.117479 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv"] Jul 02 17:06:51.187763 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.187731 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp87g\" (UniqueName: \"kubernetes.io/projected/e9f2b817-048e-422b-9f48-0e8a790644b3-kube-api-access-xp87g\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.187941 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.187783 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.187941 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.187845 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.289241 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.289200 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp87g\" (UniqueName: \"kubernetes.io/projected/e9f2b817-048e-422b-9f48-0e8a790644b3-kube-api-access-xp87g\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.289384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.289263 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.289384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.289294 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.289648 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.289627 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.289730 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.289671 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.298025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.298002 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp87g\" (UniqueName: \"kubernetes.io/projected/e9f2b817-048e-422b-9f48-0e8a790644b3-kube-api-access-xp87g\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.415831 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.415749 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:51.548902 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:51.548875 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv"] Jul 02 17:06:51.551211 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:06:51.551180 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f2b817_048e_422b_9f48_0e8a790644b3.slice/crio-5c058450e4dedb1522a0791c3312fa034062e7a0ac17728ebd5d90832d13d181 WatchSource:0}: Error finding container 5c058450e4dedb1522a0791c3312fa034062e7a0ac17728ebd5d90832d13d181: Status 404 returned error can't find the container with id 5c058450e4dedb1522a0791c3312fa034062e7a0ac17728ebd5d90832d13d181 Jul 02 17:06:52.149529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:52.149494 2535 generic.go:356] "Generic (PLEG): container finished" podID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerID="0210945d8184fa275905c04a63acd086238fe6904d8a0f012ecaecf68e47aca2" exitCode=0 Jul 02 17:06:52.149911 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:52.149580 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" event={"ID":"e9f2b817-048e-422b-9f48-0e8a790644b3","Type":"ContainerDied","Data":"0210945d8184fa275905c04a63acd086238fe6904d8a0f012ecaecf68e47aca2"} Jul 02 17:06:52.149911 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:52.149628 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" event={"ID":"e9f2b817-048e-422b-9f48-0e8a790644b3","Type":"ContainerStarted","Data":"5c058450e4dedb1522a0791c3312fa034062e7a0ac17728ebd5d90832d13d181"} Jul 02 17:06:53.156942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:53.156898 2535 generic.go:356] "Generic (PLEG): container finished" podID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerID="fa3c2e1625bcafc0795b0e7ea8beb3db8f22e792c96c5906038dcbf2228d25fe" exitCode=0 Jul 02 17:06:53.157378 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:53.156977 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" event={"ID":"e9f2b817-048e-422b-9f48-0e8a790644b3","Type":"ContainerDied","Data":"fa3c2e1625bcafc0795b0e7ea8beb3db8f22e792c96c5906038dcbf2228d25fe"} Jul 02 17:06:54.163293 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:54.163258 2535 generic.go:356] "Generic (PLEG): container finished" podID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerID="e4b1b60ff4e80e3a443123f77b93c1e79a95ba440439a7e384bf4db7c8674de7" exitCode=0 Jul 02 17:06:54.163673 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:54.163336 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" event={"ID":"e9f2b817-048e-422b-9f48-0e8a790644b3","Type":"ContainerDied","Data":"e4b1b60ff4e80e3a443123f77b93c1e79a95ba440439a7e384bf4db7c8674de7"} Jul 02 17:06:55.301667 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.301644 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:55.426237 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.426152 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-bundle\") pod \"e9f2b817-048e-422b-9f48-0e8a790644b3\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " Jul 02 17:06:55.426237 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.426221 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp87g\" (UniqueName: \"kubernetes.io/projected/e9f2b817-048e-422b-9f48-0e8a790644b3-kube-api-access-xp87g\") pod \"e9f2b817-048e-422b-9f48-0e8a790644b3\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " Jul 02 17:06:55.426429 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.426283 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-util\") pod \"e9f2b817-048e-422b-9f48-0e8a790644b3\" (UID: \"e9f2b817-048e-422b-9f48-0e8a790644b3\") " Jul 02 17:06:55.426735 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.426710 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-bundle" (OuterVolumeSpecName: "bundle") pod "e9f2b817-048e-422b-9f48-0e8a790644b3" (UID: "e9f2b817-048e-422b-9f48-0e8a790644b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:06:55.428323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.428300 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9f2b817-048e-422b-9f48-0e8a790644b3-kube-api-access-xp87g" (OuterVolumeSpecName: "kube-api-access-xp87g") pod "e9f2b817-048e-422b-9f48-0e8a790644b3" (UID: "e9f2b817-048e-422b-9f48-0e8a790644b3"). InnerVolumeSpecName "kube-api-access-xp87g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:06:55.432419 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.432396 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-util" (OuterVolumeSpecName: "util") pod "e9f2b817-048e-422b-9f48-0e8a790644b3" (UID: "e9f2b817-048e-422b-9f48-0e8a790644b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:06:55.527186 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.527139 2535 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-util\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:06:55.527186 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.527179 2535 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9f2b817-048e-422b-9f48-0e8a790644b3-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:06:55.527186 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:55.527189 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp87g\" (UniqueName: \"kubernetes.io/projected/e9f2b817-048e-422b-9f48-0e8a790644b3-kube-api-access-xp87g\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:06:56.179711 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:56.179676 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" Jul 02 17:06:56.179887 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:56.179675 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8tlxtv" event={"ID":"e9f2b817-048e-422b-9f48-0e8a790644b3","Type":"ContainerDied","Data":"5c058450e4dedb1522a0791c3312fa034062e7a0ac17728ebd5d90832d13d181"} Jul 02 17:06:56.179887 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:06:56.179801 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c058450e4dedb1522a0791c3312fa034062e7a0ac17728ebd5d90832d13d181" Jul 02 17:07:02.306397 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:02.306370 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:07:02.307071 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:02.307049 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:07:02.314006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:02.313983 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:07:02.314531 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:02.314506 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:07:14.006186 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.006146 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:14.107088 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.107053 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:14.389662 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389589 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:07:14.389903 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389882 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="util" Jul 02 17:07:14.389903 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389901 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="util" Jul 02 17:07:14.390061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389917 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="pull" Jul 02 17:07:14.390061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389922 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="pull" Jul 02 17:07:14.390061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389936 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="extract" Jul 02 17:07:14.390061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389941 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="extract" Jul 02 17:07:14.390061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.389990 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9f2b817-048e-422b-9f48-0e8a790644b3" containerName="extract" Jul 02 17:07:14.394159 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.394141 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:14.396804 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.396778 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 17:07:14.396935 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.396844 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 17:07:14.398007 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.397982 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6krgb\"" Jul 02 17:07:14.398119 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.397989 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 17:07:14.400154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.400135 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:07:14.486158 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.486126 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslh7\" (UniqueName: \"kubernetes.io/projected/1501d377-df3e-49b5-85fb-782de6eb98e5-kube-api-access-tslh7\") pod \"maas-keycloak-0\" (UID: \"1501d377-df3e-49b5-85fb-782de6eb98e5\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:14.587604 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.587566 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslh7\" (UniqueName: \"kubernetes.io/projected/1501d377-df3e-49b5-85fb-782de6eb98e5-kube-api-access-tslh7\") pod \"maas-keycloak-0\" (UID: \"1501d377-df3e-49b5-85fb-782de6eb98e5\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:14.596277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.596249 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslh7\" (UniqueName: \"kubernetes.io/projected/1501d377-df3e-49b5-85fb-782de6eb98e5-kube-api-access-tslh7\") pod \"maas-keycloak-0\" (UID: \"1501d377-df3e-49b5-85fb-782de6eb98e5\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:14.705223 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.705194 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:14.836254 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:14.836229 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:07:14.838427 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:07:14.838400 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1501d377_df3e_49b5_85fb_782de6eb98e5.slice/crio-bf75101ddfe94b4aed1aee88a79cf6be2c492a6c9e20a7c3386a3fcc33ed7297 WatchSource:0}: Error finding container bf75101ddfe94b4aed1aee88a79cf6be2c492a6c9e20a7c3386a3fcc33ed7297: Status 404 returned error can't find the container with id bf75101ddfe94b4aed1aee88a79cf6be2c492a6c9e20a7c3386a3fcc33ed7297 Jul 02 17:07:15.271883 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:15.271844 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1501d377-df3e-49b5-85fb-782de6eb98e5","Type":"ContainerStarted","Data":"bf75101ddfe94b4aed1aee88a79cf6be2c492a6c9e20a7c3386a3fcc33ed7297"} Jul 02 17:07:21.305988 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:21.305944 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1501d377-df3e-49b5-85fb-782de6eb98e5","Type":"ContainerStarted","Data":"cf67ca7fd50c33a7d2d7a5d9c93edc860bd51bdc59db05758dcfef8886d9fba0"} Jul 02 17:07:21.327585 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:21.327506 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.8248784260000002 podStartE2EDuration="7.327486102s" totalImagesPullingTime="5.502607676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:21.327425304 +0000 UTC m=+619.431443845" watchObservedRunningTime="2026-07-02 17:07:21.327486102 +0000 UTC m=+619.431504644" Jul 02 17:07:21.706390 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:21.706350 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:21.708656 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:21.708611 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:22.706245 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:22.706191 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:23.706354 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:23.706305 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:24.706226 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:24.706178 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:24.706894 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:24.706856 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:25.706132 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:25.706088 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:26.705828 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:26.705774 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:27.706760 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:27.706701 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:28.706620 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:28.706568 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:29.706116 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:29.706065 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:30.705948 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:30.705899 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:31.706165 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:31.706113 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:32.705940 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:32.705894 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jul 02 17:07:33.832694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:33.832651 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:33.852527 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:33.852481 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 17:07:43.838046 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:43.838010 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 17:07:44.541086 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.541043 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:44.793647 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.793566 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmml8"] Jul 02 17:07:44.801027 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.801005 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:44.806758 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.806727 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmml8"] Jul 02 17:07:44.867842 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.867816 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rkbx\" (UniqueName: \"kubernetes.io/projected/d413ec47-8aa1-4d59-b684-a01090da176d-kube-api-access-4rkbx\") pod \"authorino-5d4b67c446-dmml8\" (UID: \"d413ec47-8aa1-4d59-b684-a01090da176d\") " pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:44.968295 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.968262 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rkbx\" (UniqueName: \"kubernetes.io/projected/d413ec47-8aa1-4d59-b684-a01090da176d-kube-api-access-4rkbx\") pod \"authorino-5d4b67c446-dmml8\" (UID: \"d413ec47-8aa1-4d59-b684-a01090da176d\") " pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:44.976328 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:44.976303 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rkbx\" (UniqueName: \"kubernetes.io/projected/d413ec47-8aa1-4d59-b684-a01090da176d-kube-api-access-4rkbx\") pod \"authorino-5d4b67c446-dmml8\" (UID: \"d413ec47-8aa1-4d59-b684-a01090da176d\") " pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:45.044931 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.044848 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmml8"] Jul 02 17:07:45.045096 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.045083 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:45.070077 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.070041 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b76c48b8b-f8n9w"] Jul 02 17:07:45.072490 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.072466 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:45.081125 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.081099 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b76c48b8b-f8n9w"] Jul 02 17:07:45.170106 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.170074 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn6br\" (UniqueName: \"kubernetes.io/projected/d85e704c-804a-4dc7-97ef-10a5fd906d6b-kube-api-access-sn6br\") pod \"authorino-5b76c48b8b-f8n9w\" (UID: \"d85e704c-804a-4dc7-97ef-10a5fd906d6b\") " pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:45.184808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.184784 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmml8"] Jul 02 17:07:45.186698 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:07:45.186671 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd413ec47_8aa1_4d59_b684_a01090da176d.slice/crio-1fd22f936008ad0bcd2e340612977b3a34bec0fd0d577b79de8ddd59b4e07f24 WatchSource:0}: Error finding container 1fd22f936008ad0bcd2e340612977b3a34bec0fd0d577b79de8ddd59b4e07f24: Status 404 returned error can't find the container with id 1fd22f936008ad0bcd2e340612977b3a34bec0fd0d577b79de8ddd59b4e07f24 Jul 02 17:07:45.187947 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.187931 2535 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:07:45.270838 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.270804 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn6br\" (UniqueName: \"kubernetes.io/projected/d85e704c-804a-4dc7-97ef-10a5fd906d6b-kube-api-access-sn6br\") pod \"authorino-5b76c48b8b-f8n9w\" (UID: \"d85e704c-804a-4dc7-97ef-10a5fd906d6b\") " pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:45.278395 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.278366 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn6br\" (UniqueName: \"kubernetes.io/projected/d85e704c-804a-4dc7-97ef-10a5fd906d6b-kube-api-access-sn6br\") pod \"authorino-5b76c48b8b-f8n9w\" (UID: \"d85e704c-804a-4dc7-97ef-10a5fd906d6b\") " pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:45.383154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.383082 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:45.458383 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.458352 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b76c48b8b-f8n9w"] Jul 02 17:07:45.463051 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.462935 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dmml8" event={"ID":"d413ec47-8aa1-4d59-b684-a01090da176d","Type":"ContainerStarted","Data":"1fd22f936008ad0bcd2e340612977b3a34bec0fd0d577b79de8ddd59b4e07f24"} Jul 02 17:07:45.488687 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.488652 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-575dcd958-dmbjs"] Jul 02 17:07:45.491886 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.491860 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.494437 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.494419 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 17:07:45.501374 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.501353 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575dcd958-dmbjs"] Jul 02 17:07:45.515428 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:07:45.515402 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd85e704c_804a_4dc7_97ef_10a5fd906d6b.slice/crio-6f82e6591c255e1feb72317dfdf2d412f45f113cd68d4ce6d4bc6b838274e967 WatchSource:0}: Error finding container 6f82e6591c255e1feb72317dfdf2d412f45f113cd68d4ce6d4bc6b838274e967: Status 404 returned error can't find the container with id 6f82e6591c255e1feb72317dfdf2d412f45f113cd68d4ce6d4bc6b838274e967 Jul 02 17:07:45.516048 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.515973 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b76c48b8b-f8n9w"] Jul 02 17:07:45.573653 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.573628 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xh7j\" (UniqueName: \"kubernetes.io/projected/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-kube-api-access-5xh7j\") pod \"authorino-575dcd958-dmbjs\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.573784 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.573657 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-tls-cert\") pod \"authorino-575dcd958-dmbjs\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.674501 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.674422 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xh7j\" (UniqueName: \"kubernetes.io/projected/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-kube-api-access-5xh7j\") pod \"authorino-575dcd958-dmbjs\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.674501 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.674456 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-tls-cert\") pod \"authorino-575dcd958-dmbjs\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.676808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.676788 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-tls-cert\") pod \"authorino-575dcd958-dmbjs\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.682676 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.682659 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xh7j\" (UniqueName: \"kubernetes.io/projected/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-kube-api-access-5xh7j\") pod \"authorino-575dcd958-dmbjs\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.802072 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.802048 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:07:45.818894 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.818856 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:45.951455 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:45.951431 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575dcd958-dmbjs"] Jul 02 17:07:45.953089 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:07:45.953060 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2188e30_c8b7_48a6_98ba_0d3fe494e5d3.slice/crio-3e6b39893748ba58c43f647f1832e9fb6c34b85d4df6842d889be369b41975e4 WatchSource:0}: Error finding container 3e6b39893748ba58c43f647f1832e9fb6c34b85d4df6842d889be369b41975e4: Status 404 returned error can't find the container with id 3e6b39893748ba58c43f647f1832e9fb6c34b85d4df6842d889be369b41975e4 Jul 02 17:07:46.469079 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.469046 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575dcd958-dmbjs" event={"ID":"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3","Type":"ContainerStarted","Data":"cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646"} Jul 02 17:07:46.469258 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.469090 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575dcd958-dmbjs" event={"ID":"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3","Type":"ContainerStarted","Data":"3e6b39893748ba58c43f647f1832e9fb6c34b85d4df6842d889be369b41975e4"} Jul 02 17:07:46.470501 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.470467 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dmml8" event={"ID":"d413ec47-8aa1-4d59-b684-a01090da176d","Type":"ContainerStarted","Data":"b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4"} Jul 02 17:07:46.470501 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.470474 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dmml8" podUID="d413ec47-8aa1-4d59-b684-a01090da176d" containerName="authorino" containerID="cri-o://b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4" gracePeriod=30 Jul 02 17:07:46.472010 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.471985 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" event={"ID":"d85e704c-804a-4dc7-97ef-10a5fd906d6b","Type":"ContainerStarted","Data":"1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5"} Jul 02 17:07:46.472125 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.472019 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" event={"ID":"d85e704c-804a-4dc7-97ef-10a5fd906d6b","Type":"ContainerStarted","Data":"6f82e6591c255e1feb72317dfdf2d412f45f113cd68d4ce6d4bc6b838274e967"} Jul 02 17:07:46.472125 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.472055 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" podUID="d85e704c-804a-4dc7-97ef-10a5fd906d6b" containerName="authorino" containerID="cri-o://1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5" gracePeriod=30 Jul 02 17:07:46.486279 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.486240 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-575dcd958-dmbjs" podStartSLOduration=1.142575353 podStartE2EDuration="1.486227474s" totalImagesPullingTime="343.652121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:46.484463116 +0000 UTC m=+644.588481663" watchObservedRunningTime="2026-07-02 17:07:46.486227474 +0000 UTC m=+644.590245994" Jul 02 17:07:46.500752 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.500697 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dmml8" podStartSLOduration=1.952260195 podStartE2EDuration="2.500678987s" totalImagesPullingTime="548.418792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:46.498534156 +0000 UTC m=+644.602552700" watchObservedRunningTime="2026-07-02 17:07:46.500678987 +0000 UTC m=+644.604697534" Jul 02 17:07:46.518518 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.518481 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7zcnt"] Jul 02 17:07:46.518866 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.518687 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7zcnt" podUID="fff63adf-67ba-4630-85b7-9aff245564dd" containerName="authorino" containerID="cri-o://5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814" gracePeriod=30 Jul 02 17:07:46.520008 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.519966 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" podStartSLOduration=1.234126714 podStartE2EDuration="1.519952536s" totalImagesPullingTime="285.825822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:46.518196317 +0000 UTC m=+644.622214875" watchObservedRunningTime="2026-07-02 17:07:46.519952536 +0000 UTC m=+644.623971058" Jul 02 17:07:46.787748 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.787719 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:46.795336 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.795317 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:07:46.798154 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.798136 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:46.883002 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.882923 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rkbx\" (UniqueName: \"kubernetes.io/projected/d413ec47-8aa1-4d59-b684-a01090da176d-kube-api-access-4rkbx\") pod \"d413ec47-8aa1-4d59-b684-a01090da176d\" (UID: \"d413ec47-8aa1-4d59-b684-a01090da176d\") " Jul 02 17:07:46.883002 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.882961 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzttm\" (UniqueName: \"kubernetes.io/projected/fff63adf-67ba-4630-85b7-9aff245564dd-kube-api-access-nzttm\") pod \"fff63adf-67ba-4630-85b7-9aff245564dd\" (UID: \"fff63adf-67ba-4630-85b7-9aff245564dd\") " Jul 02 17:07:46.883231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.883049 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn6br\" (UniqueName: \"kubernetes.io/projected/d85e704c-804a-4dc7-97ef-10a5fd906d6b-kube-api-access-sn6br\") pod \"d85e704c-804a-4dc7-97ef-10a5fd906d6b\" (UID: \"d85e704c-804a-4dc7-97ef-10a5fd906d6b\") " Jul 02 17:07:46.885089 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.885057 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d413ec47-8aa1-4d59-b684-a01090da176d-kube-api-access-4rkbx" (OuterVolumeSpecName: "kube-api-access-4rkbx") pod "d413ec47-8aa1-4d59-b684-a01090da176d" (UID: "d413ec47-8aa1-4d59-b684-a01090da176d"). InnerVolumeSpecName "kube-api-access-4rkbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:07:46.885089 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.885080 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85e704c-804a-4dc7-97ef-10a5fd906d6b-kube-api-access-sn6br" (OuterVolumeSpecName: "kube-api-access-sn6br") pod "d85e704c-804a-4dc7-97ef-10a5fd906d6b" (UID: "d85e704c-804a-4dc7-97ef-10a5fd906d6b"). InnerVolumeSpecName "kube-api-access-sn6br". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:07:46.885237 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.885153 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff63adf-67ba-4630-85b7-9aff245564dd-kube-api-access-nzttm" (OuterVolumeSpecName: "kube-api-access-nzttm") pod "fff63adf-67ba-4630-85b7-9aff245564dd" (UID: "fff63adf-67ba-4630-85b7-9aff245564dd"). InnerVolumeSpecName "kube-api-access-nzttm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:07:46.983736 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.983705 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn6br\" (UniqueName: \"kubernetes.io/projected/d85e704c-804a-4dc7-97ef-10a5fd906d6b-kube-api-access-sn6br\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:07:46.984045 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.983739 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rkbx\" (UniqueName: \"kubernetes.io/projected/d413ec47-8aa1-4d59-b684-a01090da176d-kube-api-access-4rkbx\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:07:46.984045 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:46.983753 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzttm\" (UniqueName: \"kubernetes.io/projected/fff63adf-67ba-4630-85b7-9aff245564dd-kube-api-access-nzttm\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:07:47.478258 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.478223 2535 generic.go:356] "Generic (PLEG): container finished" podID="d85e704c-804a-4dc7-97ef-10a5fd906d6b" containerID="1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5" exitCode=0 Jul 02 17:07:47.478447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.478278 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" Jul 02 17:07:47.478447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.478309 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" event={"ID":"d85e704c-804a-4dc7-97ef-10a5fd906d6b","Type":"ContainerDied","Data":"1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5"} Jul 02 17:07:47.478447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.478356 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b76c48b8b-f8n9w" event={"ID":"d85e704c-804a-4dc7-97ef-10a5fd906d6b","Type":"ContainerDied","Data":"6f82e6591c255e1feb72317dfdf2d412f45f113cd68d4ce6d4bc6b838274e967"} Jul 02 17:07:47.478447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.478375 2535 scope.go:117] "RemoveContainer" containerID="1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5" Jul 02 17:07:47.479693 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.479601 2535 generic.go:356] "Generic (PLEG): container finished" podID="fff63adf-67ba-4630-85b7-9aff245564dd" containerID="5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814" exitCode=0 Jul 02 17:07:47.479693 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.479633 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7zcnt" event={"ID":"fff63adf-67ba-4630-85b7-9aff245564dd","Type":"ContainerDied","Data":"5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814"} Jul 02 17:07:47.479693 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.479669 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7zcnt" Jul 02 17:07:47.479856 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.479672 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7zcnt" event={"ID":"fff63adf-67ba-4630-85b7-9aff245564dd","Type":"ContainerDied","Data":"3f58734b68f64df0c2cabcff3c14ee9e27412a687a40be8c635276217dc739c9"} Jul 02 17:07:47.481026 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.481005 2535 generic.go:356] "Generic (PLEG): container finished" podID="d413ec47-8aa1-4d59-b684-a01090da176d" containerID="b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4" exitCode=0 Jul 02 17:07:47.481156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.481037 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dmml8" event={"ID":"d413ec47-8aa1-4d59-b684-a01090da176d","Type":"ContainerDied","Data":"b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4"} Jul 02 17:07:47.481156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.481052 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmml8" Jul 02 17:07:47.481156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.481065 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dmml8" event={"ID":"d413ec47-8aa1-4d59-b684-a01090da176d","Type":"ContainerDied","Data":"1fd22f936008ad0bcd2e340612977b3a34bec0fd0d577b79de8ddd59b4e07f24"} Jul 02 17:07:47.488981 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.488950 2535 scope.go:117] "RemoveContainer" containerID="1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5" Jul 02 17:07:47.489252 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:07:47.489233 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5\": container with ID starting with 1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5 not found: ID does not exist" containerID="1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5" Jul 02 17:07:47.489344 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.489262 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5"} err="failed to get container status \"1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5\": rpc error: code = NotFound desc = could not find container \"1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5\": container with ID starting with 1762cca9b3815cd9e4675dd6a4d2df3c61fd5a63f3f4c566cb53af0f1f90f3b5 not found: ID does not exist" Jul 02 17:07:47.489344 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.489285 2535 scope.go:117] "RemoveContainer" containerID="5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814" Jul 02 17:07:47.497706 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.497690 2535 scope.go:117] "RemoveContainer" containerID="5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814" Jul 02 17:07:47.497933 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:07:47.497916 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814\": container with ID starting with 5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814 not found: ID does not exist" containerID="5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814" Jul 02 17:07:47.497982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.497940 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814"} err="failed to get container status \"5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814\": rpc error: code = NotFound desc = could not find container \"5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814\": container with ID starting with 5935ed28401d7af86a2690f935a457db5c3a49a3b2611c4d3e80cb746bf06814 not found: ID does not exist" Jul 02 17:07:47.497982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.497955 2535 scope.go:117] "RemoveContainer" containerID="b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4" Jul 02 17:07:47.505747 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.505728 2535 scope.go:117] "RemoveContainer" containerID="b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4" Jul 02 17:07:47.505996 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:07:47.505980 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4\": container with ID starting with b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4 not found: ID does not exist" containerID="b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4" Jul 02 17:07:47.506046 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.506002 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4"} err="failed to get container status \"b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4\": rpc error: code = NotFound desc = could not find container \"b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4\": container with ID starting with b0f410425c0c3f0eb3c17787798ad9d25e055a2bc88dc0f15662ffcfb229f0a4 not found: ID does not exist" Jul 02 17:07:47.506590 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.506570 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b76c48b8b-f8n9w"] Jul 02 17:07:47.510625 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.510606 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b76c48b8b-f8n9w"] Jul 02 17:07:47.520915 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.520885 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7zcnt"] Jul 02 17:07:47.524695 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.524675 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7zcnt"] Jul 02 17:07:47.534696 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.534673 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmml8"] Jul 02 17:07:47.536678 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.536649 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmml8"] Jul 02 17:07:47.711865 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:47.711829 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:48.389374 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:48.389342 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d413ec47-8aa1-4d59-b684-a01090da176d" path="/var/lib/kubelet/pods/d413ec47-8aa1-4d59-b684-a01090da176d/volumes" Jul 02 17:07:48.389740 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:48.389677 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85e704c-804a-4dc7-97ef-10a5fd906d6b" path="/var/lib/kubelet/pods/d85e704c-804a-4dc7-97ef-10a5fd906d6b/volumes" Jul 02 17:07:48.389958 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:48.389946 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff63adf-67ba-4630-85b7-9aff245564dd" path="/var/lib/kubelet/pods/fff63adf-67ba-4630-85b7-9aff245564dd/volumes" Jul 02 17:07:51.407529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:51.407495 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:51.598694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:51.598656 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:51.723011 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:51.722979 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:51.816410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:51.816373 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:54.897578 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:54.897527 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:07:55.021214 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:07:55.021178 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:08:25.612221 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:25.612181 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:08:26.058035 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:26.057998 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:08:26.152985 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:26.152943 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:08:26.510575 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:26.510529 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:08:26.620732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:26.620697 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:08:36.199104 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:36.199063 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:08:36.199652 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:36.199254 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" containerID="cri-o://cf67ca7fd50c33a7d2d7a5d9c93edc860bd51bdc59db05758dcfef8886d9fba0" gracePeriod=30 Jul 02 17:08:37.735294 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:37.735261 2535 generic.go:356] "Generic (PLEG): container finished" podID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerID="cf67ca7fd50c33a7d2d7a5d9c93edc860bd51bdc59db05758dcfef8886d9fba0" exitCode=143 Jul 02 17:08:37.735683 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:37.735326 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1501d377-df3e-49b5-85fb-782de6eb98e5","Type":"ContainerDied","Data":"cf67ca7fd50c33a7d2d7a5d9c93edc860bd51bdc59db05758dcfef8886d9fba0"} Jul 02 17:08:38.253084 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.253059 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:38.312405 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.312369 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tslh7\" (UniqueName: \"kubernetes.io/projected/1501d377-df3e-49b5-85fb-782de6eb98e5-kube-api-access-tslh7\") pod \"1501d377-df3e-49b5-85fb-782de6eb98e5\" (UID: \"1501d377-df3e-49b5-85fb-782de6eb98e5\") " Jul 02 17:08:38.314613 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.314586 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1501d377-df3e-49b5-85fb-782de6eb98e5-kube-api-access-tslh7" (OuterVolumeSpecName: "kube-api-access-tslh7") pod "1501d377-df3e-49b5-85fb-782de6eb98e5" (UID: "1501d377-df3e-49b5-85fb-782de6eb98e5"). InnerVolumeSpecName "kube-api-access-tslh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:08:38.413869 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.413845 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tslh7\" (UniqueName: \"kubernetes.io/projected/1501d377-df3e-49b5-85fb-782de6eb98e5-kube-api-access-tslh7\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:08:38.741749 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.741725 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:38.741749 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.741742 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1501d377-df3e-49b5-85fb-782de6eb98e5","Type":"ContainerDied","Data":"bf75101ddfe94b4aed1aee88a79cf6be2c492a6c9e20a7c3386a3fcc33ed7297"} Jul 02 17:08:38.742236 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.741795 2535 scope.go:117] "RemoveContainer" containerID="cf67ca7fd50c33a7d2d7a5d9c93edc860bd51bdc59db05758dcfef8886d9fba0" Jul 02 17:08:38.762673 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.762650 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:08:38.764602 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.764583 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:08:38.786975 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.786948 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:08:38.787329 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787311 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" Jul 02 17:08:38.787410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787332 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" Jul 02 17:08:38.787410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787364 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff63adf-67ba-4630-85b7-9aff245564dd" containerName="authorino" Jul 02 17:08:38.787410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787386 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff63adf-67ba-4630-85b7-9aff245564dd" containerName="authorino" Jul 02 17:08:38.787410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787397 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85e704c-804a-4dc7-97ef-10a5fd906d6b" containerName="authorino" Jul 02 17:08:38.787410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787408 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85e704c-804a-4dc7-97ef-10a5fd906d6b" containerName="authorino" Jul 02 17:08:38.787694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787436 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d413ec47-8aa1-4d59-b684-a01090da176d" containerName="authorino" Jul 02 17:08:38.787694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787446 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="d413ec47-8aa1-4d59-b684-a01090da176d" containerName="authorino" Jul 02 17:08:38.787694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787531 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="d413ec47-8aa1-4d59-b684-a01090da176d" containerName="authorino" Jul 02 17:08:38.787694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787559 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff63adf-67ba-4630-85b7-9aff245564dd" containerName="authorino" Jul 02 17:08:38.787694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787572 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" containerName="keycloak" Jul 02 17:08:38.787694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.787582 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85e704c-804a-4dc7-97ef-10a5fd906d6b" containerName="authorino" Jul 02 17:08:38.790534 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.790515 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:38.795456 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.795427 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 17:08:38.795584 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.795430 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 17:08:38.795584 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.795426 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 02 17:08:38.795584 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.795565 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 17:08:38.795725 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.795433 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6krgb\"" Jul 02 17:08:38.806587 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.806566 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:08:38.917130 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.917094 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljrvm\" (UniqueName: \"kubernetes.io/projected/4aa7129b-4471-4912-a27b-6284a5700fe2-kube-api-access-ljrvm\") pod \"maas-keycloak-0\" (UID: \"4aa7129b-4471-4912-a27b-6284a5700fe2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:38.917300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:38.917140 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4aa7129b-4471-4912-a27b-6284a5700fe2-test-realms\") pod \"maas-keycloak-0\" (UID: \"4aa7129b-4471-4912-a27b-6284a5700fe2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:39.017606 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.017489 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljrvm\" (UniqueName: \"kubernetes.io/projected/4aa7129b-4471-4912-a27b-6284a5700fe2-kube-api-access-ljrvm\") pod \"maas-keycloak-0\" (UID: \"4aa7129b-4471-4912-a27b-6284a5700fe2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:39.017606 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.017569 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4aa7129b-4471-4912-a27b-6284a5700fe2-test-realms\") pod \"maas-keycloak-0\" (UID: \"4aa7129b-4471-4912-a27b-6284a5700fe2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:39.018276 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.018256 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4aa7129b-4471-4912-a27b-6284a5700fe2-test-realms\") pod \"maas-keycloak-0\" (UID: \"4aa7129b-4471-4912-a27b-6284a5700fe2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:39.025802 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.025770 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljrvm\" (UniqueName: \"kubernetes.io/projected/4aa7129b-4471-4912-a27b-6284a5700fe2-kube-api-access-ljrvm\") pod \"maas-keycloak-0\" (UID: \"4aa7129b-4471-4912-a27b-6284a5700fe2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:39.099802 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.099767 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:39.233030 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.232994 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 17:08:39.234576 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:08:39.234534 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa7129b_4471_4912_a27b_6284a5700fe2.slice/crio-7a3a6a1e71b4f9275e888893b8e95ad99352c6806468bce96608d8e51ef4ff8b WatchSource:0}: Error finding container 7a3a6a1e71b4f9275e888893b8e95ad99352c6806468bce96608d8e51ef4ff8b: Status 404 returned error can't find the container with id 7a3a6a1e71b4f9275e888893b8e95ad99352c6806468bce96608d8e51ef4ff8b Jul 02 17:08:39.750179 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.750148 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4aa7129b-4471-4912-a27b-6284a5700fe2","Type":"ContainerStarted","Data":"6fd3e55c22f703cbdb285f81480cdc385f21f7daab34db2f3d37c2226219218a"} Jul 02 17:08:39.750572 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.750200 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4aa7129b-4471-4912-a27b-6284a5700fe2","Type":"ContainerStarted","Data":"7a3a6a1e71b4f9275e888893b8e95ad99352c6806468bce96608d8e51ef4ff8b"} Jul 02 17:08:39.770081 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:39.770039 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.361562378 podStartE2EDuration="1.770022707s" totalImagesPullingTime="408.460329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:08:39.769078097 +0000 UTC m=+697.873096639" watchObservedRunningTime="2026-07-02 17:08:39.770022707 +0000 UTC m=+697.874041306" Jul 02 17:08:40.100376 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:40.100335 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:40.101751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:40.101721 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:40.390085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:40.389987 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1501d377-df3e-49b5-85fb-782de6eb98e5" path="/var/lib/kubelet/pods/1501d377-df3e-49b5-85fb-782de6eb98e5/volumes" Jul 02 17:08:41.100928 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:41.100816 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:42.100271 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:42.100217 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:43.100515 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:43.100459 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:44.100218 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:44.100177 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:45.100513 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:45.100452 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:46.101215 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:46.101157 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:47.100768 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:47.100717 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:48.100901 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:48.100857 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:49.100847 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:49.100790 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:49.101133 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:49.101064 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:50.100669 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:50.100623 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:51.101100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:51.101044 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:52.100413 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:52.100372 2535 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jul 02 17:08:53.223082 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:53.223049 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 17:08:53.240337 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:53.240296 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4aa7129b-4471-4912-a27b-6284a5700fe2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 17:08:57.939955 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:08:57.939864 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:00.998394 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:00.998347 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:03.230011 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:03.229977 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 17:09:14.026952 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.026916 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-594f444d8-f98bx"] Jul 02 17:09:14.029782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.029763 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.032229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.032206 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 02 17:09:14.038881 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.038858 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594f444d8-f98bx"] Jul 02 17:09:14.152823 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.152783 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcbbe733-aefd-4f8f-b11c-ca356116499f-tls-cert\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.153025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.152846 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts92q\" (UniqueName: \"kubernetes.io/projected/bcbbe733-aefd-4f8f-b11c-ca356116499f-kube-api-access-ts92q\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.153025 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.152920 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcbbe733-aefd-4f8f-b11c-ca356116499f-oidc-ca\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.253946 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.253915 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcbbe733-aefd-4f8f-b11c-ca356116499f-oidc-ca\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.254109 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.253970 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcbbe733-aefd-4f8f-b11c-ca356116499f-tls-cert\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.254109 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.254005 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts92q\" (UniqueName: \"kubernetes.io/projected/bcbbe733-aefd-4f8f-b11c-ca356116499f-kube-api-access-ts92q\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.254599 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.254566 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcbbe733-aefd-4f8f-b11c-ca356116499f-oidc-ca\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.256375 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.256345 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcbbe733-aefd-4f8f-b11c-ca356116499f-tls-cert\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.261804 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.261778 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts92q\" (UniqueName: \"kubernetes.io/projected/bcbbe733-aefd-4f8f-b11c-ca356116499f-kube-api-access-ts92q\") pod \"authorino-594f444d8-f98bx\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.338806 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.338726 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:09:14.467409 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.467266 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594f444d8-f98bx"] Jul 02 17:09:14.470024 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:09:14.469995 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcbbe733_aefd_4f8f_b11c_ca356116499f.slice/crio-04389a00cc88c0a28a1fd96d7edfe2ba96406b96f2f431e1482d44ce3f8506dd WatchSource:0}: Error finding container 04389a00cc88c0a28a1fd96d7edfe2ba96406b96f2f431e1482d44ce3f8506dd: Status 404 returned error can't find the container with id 04389a00cc88c0a28a1fd96d7edfe2ba96406b96f2f431e1482d44ce3f8506dd Jul 02 17:09:14.964412 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:14.964386 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f444d8-f98bx" event={"ID":"bcbbe733-aefd-4f8f-b11c-ca356116499f","Type":"ContainerStarted","Data":"04389a00cc88c0a28a1fd96d7edfe2ba96406b96f2f431e1482d44ce3f8506dd"} Jul 02 17:09:15.970611 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:15.970576 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f444d8-f98bx" event={"ID":"bcbbe733-aefd-4f8f-b11c-ca356116499f","Type":"ContainerStarted","Data":"dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1"} Jul 02 17:09:15.989042 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:15.988986 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-594f444d8-f98bx" podStartSLOduration=1.507456387 podStartE2EDuration="1.988969863s" totalImagesPullingTime="481.513476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:09:15.987781875 +0000 UTC m=+734.091800426" watchObservedRunningTime="2026-07-02 17:09:15.988969863 +0000 UTC m=+734.092988402" Jul 02 17:09:16.019181 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.019143 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575dcd958-dmbjs"] Jul 02 17:09:16.019380 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.019355 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-575dcd958-dmbjs" podUID="a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" containerName="authorino" containerID="cri-o://cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646" gracePeriod=30 Jul 02 17:09:16.273576 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.273526 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:09:16.372158 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.372126 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-tls-cert\") pod \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " Jul 02 17:09:16.372343 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.372203 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xh7j\" (UniqueName: \"kubernetes.io/projected/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-kube-api-access-5xh7j\") pod \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\" (UID: \"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3\") " Jul 02 17:09:16.374260 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.374230 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-kube-api-access-5xh7j" (OuterVolumeSpecName: "kube-api-access-5xh7j") pod "a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" (UID: "a2188e30-c8b7-48a6-98ba-0d3fe494e5d3"). InnerVolumeSpecName "kube-api-access-5xh7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:09:16.381886 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.381859 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" (UID: "a2188e30-c8b7-48a6-98ba-0d3fe494e5d3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:09:16.473345 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.473315 2535 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-tls-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:09:16.473345 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.473342 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xh7j\" (UniqueName: \"kubernetes.io/projected/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3-kube-api-access-5xh7j\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:09:16.711124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.711084 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:16.810836 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.810804 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:16.976379 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.976282 2535 generic.go:356] "Generic (PLEG): container finished" podID="a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" containerID="cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646" exitCode=0 Jul 02 17:09:16.976379 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.976332 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575dcd958-dmbjs" Jul 02 17:09:16.976379 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.976370 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575dcd958-dmbjs" event={"ID":"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3","Type":"ContainerDied","Data":"cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646"} Jul 02 17:09:16.976968 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.976412 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575dcd958-dmbjs" event={"ID":"a2188e30-c8b7-48a6-98ba-0d3fe494e5d3","Type":"ContainerDied","Data":"3e6b39893748ba58c43f647f1832e9fb6c34b85d4df6842d889be369b41975e4"} Jul 02 17:09:16.976968 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.976433 2535 scope.go:117] "RemoveContainer" containerID="cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646" Jul 02 17:09:16.985020 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.984998 2535 scope.go:117] "RemoveContainer" containerID="cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646" Jul 02 17:09:16.985290 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:09:16.985270 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646\": container with ID starting with cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646 not found: ID does not exist" containerID="cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646" Jul 02 17:09:16.985338 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.985298 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646"} err="failed to get container status \"cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646\": rpc error: code = NotFound desc = could not find container \"cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646\": container with ID starting with cc7cbead6d433958c8a4e34f17bbfd1a91ffb9653f502e8f4340e5813e2d0646 not found: ID does not exist" Jul 02 17:09:16.993048 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.993020 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575dcd958-dmbjs"] Jul 02 17:09:16.998871 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:16.998849 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-575dcd958-dmbjs"] Jul 02 17:09:18.391010 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:18.390968 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" path="/var/lib/kubelet/pods/a2188e30-c8b7-48a6-98ba-0d3fe494e5d3/volumes" Jul 02 17:09:24.784828 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:24.784794 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:24.882881 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:24.882847 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:25.305446 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.305413 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv"] Jul 02 17:09:25.305751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.305738 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" containerName="authorino" Jul 02 17:09:25.305751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.305751 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" containerName="authorino" Jul 02 17:09:25.305844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.305825 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2188e30-c8b7-48a6-98ba-0d3fe494e5d3" containerName="authorino" Jul 02 17:09:25.308412 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.308395 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.311515 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.311489 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 17:09:25.312367 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.312344 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 17:09:25.312699 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.312679 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 17:09:25.312797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.312709 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5lqpq\"" Jul 02 17:09:25.319637 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.319615 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv"] Jul 02 17:09:25.326959 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.326930 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:25.448187 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.448154 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.448407 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.448199 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.448407 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.448223 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.448407 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.448237 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff4d029-1a25-48ca-9035-2884d16b8fa2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.448407 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.448252 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.448407 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.448343 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzh6t\" (UniqueName: \"kubernetes.io/projected/0ff4d029-1a25-48ca-9035-2884d16b8fa2-kube-api-access-tzh6t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.549496 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.549458 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.549718 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.549507 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.549718 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.549532 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.549718 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.549566 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff4d029-1a25-48ca-9035-2884d16b8fa2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.549718 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.549583 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.549718 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.549606 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzh6t\" (UniqueName: \"kubernetes.io/projected/0ff4d029-1a25-48ca-9035-2884d16b8fa2-kube-api-access-tzh6t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.550035 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.550007 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.550081 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.550031 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.550081 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.550054 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.551979 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.551954 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ff4d029-1a25-48ca-9035-2884d16b8fa2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.552181 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.552162 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ff4d029-1a25-48ca-9035-2884d16b8fa2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.558313 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.558262 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzh6t\" (UniqueName: \"kubernetes.io/projected/0ff4d029-1a25-48ca-9035-2884d16b8fa2-kube-api-access-tzh6t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv\" (UID: \"0ff4d029-1a25-48ca-9035-2884d16b8fa2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.618145 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.618117 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:25.750298 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:25.750270 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv"] Jul 02 17:09:25.751331 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:09:25.751290 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff4d029_1a25_48ca_9035_2884d16b8fa2.slice/crio-6ff7be9c51ec1c87e28045ffe9db1cb3f47b8d504514a635bb79b964d79e32d6 WatchSource:0}: Error finding container 6ff7be9c51ec1c87e28045ffe9db1cb3f47b8d504514a635bb79b964d79e32d6: Status 404 returned error can't find the container with id 6ff7be9c51ec1c87e28045ffe9db1cb3f47b8d504514a635bb79b964d79e32d6 Jul 02 17:09:26.028012 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:26.027923 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" event={"ID":"0ff4d029-1a25-48ca-9035-2884d16b8fa2","Type":"ContainerStarted","Data":"6ff7be9c51ec1c87e28045ffe9db1cb3f47b8d504514a635bb79b964d79e32d6"} Jul 02 17:09:27.034743 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:27.034707 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" event={"ID":"0ff4d029-1a25-48ca-9035-2884d16b8fa2","Type":"ContainerStarted","Data":"f8ec66bc167f8022ef5d9832d5307cb80091a8ebe96e0a21fcaa9e79cbfd3820"} Jul 02 17:09:27.053281 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:27.053230 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" podStartSLOduration=0.914283904 podStartE2EDuration="2.053213609s" totalImagesPullingTime="1.138929705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:09:27.051954596 +0000 UTC m=+745.155973139" watchObservedRunningTime="2026-07-02 17:09:27.053213609 +0000 UTC m=+745.157232151" Jul 02 17:09:33.735333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:33.735296 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:35.618667 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:35.618634 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:35.619090 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:35.618695 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:35.631161 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:35.631131 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:36.093165 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:36.093128 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv" Jul 02 17:09:39.338459 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:39.338422 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:47.785469 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:47.785427 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:09:58.245940 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:09:58.245903 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:10:14.734583 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:10:14.734528 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:10:28.317430 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:10:28.317394 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:11.139256 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:11.139221 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:11.195976 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:11.195942 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:17.925948 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:17.925910 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:18.026801 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:18.026766 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:35.281468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.281430 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5769466bd9-h6twg"] Jul 02 17:11:35.284506 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.284488 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.292513 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.292487 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5769466bd9-h6twg"] Jul 02 17:11:35.446657 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.446619 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8b1760a-221a-41c9-bcd6-a7ec625322ad-oidc-ca\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.446828 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.446663 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx2ct\" (UniqueName: \"kubernetes.io/projected/b8b1760a-221a-41c9-bcd6-a7ec625322ad-kube-api-access-mx2ct\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.446828 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.446743 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b1760a-221a-41c9-bcd6-a7ec625322ad-tls-cert\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.547917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.547838 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8b1760a-221a-41c9-bcd6-a7ec625322ad-oidc-ca\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.547917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.547875 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx2ct\" (UniqueName: \"kubernetes.io/projected/b8b1760a-221a-41c9-bcd6-a7ec625322ad-kube-api-access-mx2ct\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.547917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.547900 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b1760a-221a-41c9-bcd6-a7ec625322ad-tls-cert\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.548531 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.548506 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b8b1760a-221a-41c9-bcd6-a7ec625322ad-oidc-ca\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.550276 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.550258 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b1760a-221a-41c9-bcd6-a7ec625322ad-tls-cert\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.556243 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.556224 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx2ct\" (UniqueName: \"kubernetes.io/projected/b8b1760a-221a-41c9-bcd6-a7ec625322ad-kube-api-access-mx2ct\") pod \"authorino-5769466bd9-h6twg\" (UID: \"b8b1760a-221a-41c9-bcd6-a7ec625322ad\") " pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.594324 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.594299 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5769466bd9-h6twg" Jul 02 17:11:35.722886 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.722862 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5769466bd9-h6twg"] Jul 02 17:11:35.724489 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:11:35.724461 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8b1760a_221a_41c9_bcd6_a7ec625322ad.slice/crio-bc4dcb2c59d050a5c3ecc0b0fb87b82fe8d00245dd082d169960b2486c2b069f WatchSource:0}: Error finding container bc4dcb2c59d050a5c3ecc0b0fb87b82fe8d00245dd082d169960b2486c2b069f: Status 404 returned error can't find the container with id bc4dcb2c59d050a5c3ecc0b0fb87b82fe8d00245dd082d169960b2486c2b069f Jul 02 17:11:35.827710 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.827629 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:35.928530 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:35.928490 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:36.694665 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:36.693816 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5769466bd9-h6twg" event={"ID":"b8b1760a-221a-41c9-bcd6-a7ec625322ad","Type":"ContainerStarted","Data":"34f6dd88f6473c1eb335182359459093a600a2210ccfa35790cc1ed088dbfaaa"} Jul 02 17:11:36.694665 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:36.693868 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5769466bd9-h6twg" event={"ID":"b8b1760a-221a-41c9-bcd6-a7ec625322ad","Type":"ContainerStarted","Data":"bc4dcb2c59d050a5c3ecc0b0fb87b82fe8d00245dd082d169960b2486c2b069f"} Jul 02 17:11:36.714172 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:36.714088 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5769466bd9-h6twg" podStartSLOduration=1.108731732 podStartE2EDuration="1.714065376s" totalImagesPullingTime="605.333644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:36.713404001 +0000 UTC m=+874.817422545" watchObservedRunningTime="2026-07-02 17:11:36.714065376 +0000 UTC m=+874.818083920" Jul 02 17:11:36.753418 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:36.753383 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-594f444d8-f98bx"] Jul 02 17:11:36.753884 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:36.753647 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-594f444d8-f98bx" podUID="bcbbe733-aefd-4f8f-b11c-ca356116499f" containerName="authorino" containerID="cri-o://dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1" gracePeriod=30 Jul 02 17:11:37.022159 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.022122 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:37.031084 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.031054 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:11:37.126376 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.126335 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:11:37.160015 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.159984 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcbbe733-aefd-4f8f-b11c-ca356116499f-tls-cert\") pod \"bcbbe733-aefd-4f8f-b11c-ca356116499f\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " Jul 02 17:11:37.160214 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.160029 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts92q\" (UniqueName: \"kubernetes.io/projected/bcbbe733-aefd-4f8f-b11c-ca356116499f-kube-api-access-ts92q\") pod \"bcbbe733-aefd-4f8f-b11c-ca356116499f\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " Jul 02 17:11:37.160214 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.160110 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcbbe733-aefd-4f8f-b11c-ca356116499f-oidc-ca\") pod \"bcbbe733-aefd-4f8f-b11c-ca356116499f\" (UID: \"bcbbe733-aefd-4f8f-b11c-ca356116499f\") " Jul 02 17:11:37.162162 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.162134 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcbbe733-aefd-4f8f-b11c-ca356116499f-kube-api-access-ts92q" (OuterVolumeSpecName: "kube-api-access-ts92q") pod "bcbbe733-aefd-4f8f-b11c-ca356116499f" (UID: "bcbbe733-aefd-4f8f-b11c-ca356116499f"). InnerVolumeSpecName "kube-api-access-ts92q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:11:37.164746 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.164717 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcbbe733-aefd-4f8f-b11c-ca356116499f-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "bcbbe733-aefd-4f8f-b11c-ca356116499f" (UID: "bcbbe733-aefd-4f8f-b11c-ca356116499f"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:11:37.170054 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.170025 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcbbe733-aefd-4f8f-b11c-ca356116499f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bcbbe733-aefd-4f8f-b11c-ca356116499f" (UID: "bcbbe733-aefd-4f8f-b11c-ca356116499f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 17:11:37.261367 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.261279 2535 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcbbe733-aefd-4f8f-b11c-ca356116499f-tls-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:11:37.261367 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.261321 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts92q\" (UniqueName: \"kubernetes.io/projected/bcbbe733-aefd-4f8f-b11c-ca356116499f-kube-api-access-ts92q\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:11:37.261367 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.261338 2535 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcbbe733-aefd-4f8f-b11c-ca356116499f-oidc-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:11:37.700442 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.700407 2535 generic.go:356] "Generic (PLEG): container finished" podID="bcbbe733-aefd-4f8f-b11c-ca356116499f" containerID="dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1" exitCode=0 Jul 02 17:11:37.700920 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.700453 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f444d8-f98bx" Jul 02 17:11:37.700920 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.700489 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f444d8-f98bx" event={"ID":"bcbbe733-aefd-4f8f-b11c-ca356116499f","Type":"ContainerDied","Data":"dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1"} Jul 02 17:11:37.700920 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.700528 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f444d8-f98bx" event={"ID":"bcbbe733-aefd-4f8f-b11c-ca356116499f","Type":"ContainerDied","Data":"04389a00cc88c0a28a1fd96d7edfe2ba96406b96f2f431e1482d44ce3f8506dd"} Jul 02 17:11:37.700920 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.700565 2535 scope.go:117] "RemoveContainer" containerID="dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1" Jul 02 17:11:37.711239 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.711216 2535 scope.go:117] "RemoveContainer" containerID="dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1" Jul 02 17:11:37.711573 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:11:37.711534 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1\": container with ID starting with dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1 not found: ID does not exist" containerID="dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1" Jul 02 17:11:37.711660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.711584 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1"} err="failed to get container status \"dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1\": rpc error: code = NotFound desc = could not find container \"dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1\": container with ID starting with dd72373cf83e37d2a4334b1e596d232049296683b62194c6a39d6ed1e8d511e1 not found: ID does not exist" Jul 02 17:11:37.723909 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.723871 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-594f444d8-f98bx"] Jul 02 17:11:37.728312 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:37.728280 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-594f444d8-f98bx"] Jul 02 17:11:38.390259 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:11:38.390217 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcbbe733-aefd-4f8f-b11c-ca356116499f" path="/var/lib/kubelet/pods/bcbbe733-aefd-4f8f-b11c-ca356116499f/volumes" Jul 02 17:12:02.346041 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:12:02.345961 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:12:02.346632 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:12:02.346183 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:12:02.356014 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:12:02.355943 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:12:02.356895 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:12:02.356875 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:12:50.491860 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:12:50.491819 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:12:51.941865 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:12:51.941790 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:14.258938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:14.258892 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:14.361712 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:14.361679 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:30.459528 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:30.459488 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:30.559446 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:30.559410 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:30.675650 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:30.675616 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:36.470132 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:36.470090 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:36.549808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:36.549767 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:36.630973 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:36.630929 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:36.847406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:36.847300 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:42.733506 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:42.733469 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:13:42.808551 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:13:42.808491 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:15:00.143584 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.143500 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29716875-h9l8l"] Jul 02 17:15:00.144023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.143849 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcbbe733-aefd-4f8f-b11c-ca356116499f" containerName="authorino" Jul 02 17:15:00.144023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.143860 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcbbe733-aefd-4f8f-b11c-ca356116499f" containerName="authorino" Jul 02 17:15:00.144023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.143914 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcbbe733-aefd-4f8f-b11c-ca356116499f" containerName="authorino" Jul 02 17:15:00.146225 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.146208 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:00.148670 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.148647 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cq75x\"" Jul 02 17:15:00.163868 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.163840 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716875-h9l8l"] Jul 02 17:15:00.247449 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.247417 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9wz\" (UniqueName: \"kubernetes.io/projected/8aab71ba-8c96-4c1c-800c-f8a8907925b5-kube-api-access-kz9wz\") pod \"maas-api-key-cleanup-29716875-h9l8l\" (UID: \"8aab71ba-8c96-4c1c-800c-f8a8907925b5\") " pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:00.348216 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.348173 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9wz\" (UniqueName: \"kubernetes.io/projected/8aab71ba-8c96-4c1c-800c-f8a8907925b5-kube-api-access-kz9wz\") pod \"maas-api-key-cleanup-29716875-h9l8l\" (UID: \"8aab71ba-8c96-4c1c-800c-f8a8907925b5\") " pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:00.356424 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.356396 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9wz\" (UniqueName: \"kubernetes.io/projected/8aab71ba-8c96-4c1c-800c-f8a8907925b5-kube-api-access-kz9wz\") pod \"maas-api-key-cleanup-29716875-h9l8l\" (UID: \"8aab71ba-8c96-4c1c-800c-f8a8907925b5\") " pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:00.456014 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.455987 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:00.586079 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.586054 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716875-h9l8l"] Jul 02 17:15:00.587753 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:15:00.587727 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aab71ba_8c96_4c1c_800c_f8a8907925b5.slice/crio-13c9dfe638b10d73134e72f5abac2852fcc37ea4779d007e58f2ffd97495adee WatchSource:0}: Error finding container 13c9dfe638b10d73134e72f5abac2852fcc37ea4779d007e58f2ffd97495adee: Status 404 returned error can't find the container with id 13c9dfe638b10d73134e72f5abac2852fcc37ea4779d007e58f2ffd97495adee Jul 02 17:15:00.592988 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.592969 2535 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 17:15:00.724664 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:00.724574 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" event={"ID":"8aab71ba-8c96-4c1c-800c-f8a8907925b5","Type":"ContainerStarted","Data":"13c9dfe638b10d73134e72f5abac2852fcc37ea4779d007e58f2ffd97495adee"} Jul 02 17:15:03.742532 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:03.742495 2535 generic.go:356] "Generic (PLEG): container finished" podID="8aab71ba-8c96-4c1c-800c-f8a8907925b5" containerID="4494b7cd0952ac1d0432178bd6f1ceece9e1a0711690f307e289faa524061fa9" exitCode=0 Jul 02 17:15:03.742885 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:03.742590 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" event={"ID":"8aab71ba-8c96-4c1c-800c-f8a8907925b5","Type":"ContainerDied","Data":"4494b7cd0952ac1d0432178bd6f1ceece9e1a0711690f307e289faa524061fa9"} Jul 02 17:15:04.875428 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:04.875402 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:04.987642 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:04.987608 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz9wz\" (UniqueName: \"kubernetes.io/projected/8aab71ba-8c96-4c1c-800c-f8a8907925b5-kube-api-access-kz9wz\") pod \"8aab71ba-8c96-4c1c-800c-f8a8907925b5\" (UID: \"8aab71ba-8c96-4c1c-800c-f8a8907925b5\") " Jul 02 17:15:04.989832 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:04.989809 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aab71ba-8c96-4c1c-800c-f8a8907925b5-kube-api-access-kz9wz" (OuterVolumeSpecName: "kube-api-access-kz9wz") pod "8aab71ba-8c96-4c1c-800c-f8a8907925b5" (UID: "8aab71ba-8c96-4c1c-800c-f8a8907925b5"). InnerVolumeSpecName "kube-api-access-kz9wz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:15:05.088470 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:05.088386 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz9wz\" (UniqueName: \"kubernetes.io/projected/8aab71ba-8c96-4c1c-800c-f8a8907925b5-kube-api-access-kz9wz\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:15:05.754505 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:05.754477 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" Jul 02 17:15:05.754844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:05.754475 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716875-h9l8l" event={"ID":"8aab71ba-8c96-4c1c-800c-f8a8907925b5","Type":"ContainerDied","Data":"13c9dfe638b10d73134e72f5abac2852fcc37ea4779d007e58f2ffd97495adee"} Jul 02 17:15:05.754844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:15:05.754608 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13c9dfe638b10d73134e72f5abac2852fcc37ea4779d007e58f2ffd97495adee" Jul 02 17:16:09.812948 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:16:09.812914 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:16:41.294679 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:16:41.294639 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:17:02.381810 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:17:02.381780 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:17:02.385457 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:17:02.385429 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:17:02.390123 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:17:02.390102 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:17:02.393357 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:17:02.393336 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:19:37.359085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:19:37.359049 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:22:02.415874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:22:02.415841 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:22:02.422124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:22:02.422100 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:22:02.423452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:22:02.423430 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:22:02.429075 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:22:02.429057 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:22:37.255181 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:22:37.255145 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:22:37.321058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:22:37.321006 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:27.369641 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:27.369553 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:32.672893 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:32.672852 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:40.931876 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:40.931844 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:46.011475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:46.011443 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:49.036331 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:49.036291 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:49.127113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:49.127076 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:49.491514 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:49.491483 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:55.679374 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.679342 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:55.784099 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.784065 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:55.924337 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.924305 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn"] Jul 02 17:24:55.924663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.924650 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aab71ba-8c96-4c1c-800c-f8a8907925b5" containerName="cleanup" Jul 02 17:24:55.924718 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.924664 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aab71ba-8c96-4c1c-800c-f8a8907925b5" containerName="cleanup" Jul 02 17:24:55.924755 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.924734 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aab71ba-8c96-4c1c-800c-f8a8907925b5" containerName="cleanup" Jul 02 17:24:55.928019 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.927993 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:55.930408 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.930348 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9fa643a0-openshift-default-dockercfg-wfbdj\"" Jul 02 17:24:55.949955 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.949925 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn"] Jul 02 17:24:55.957195 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:55.957171 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:56.024528 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.024494 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:56.055796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055764 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-certs\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.055947 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055819 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-envoy\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.055947 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055897 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-podinfo\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.055947 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055929 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-token\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.056065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055948 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-socket\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.056065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055963 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-data\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.056065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.055988 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istiod-ca-cert\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.056065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.056011 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktg2f\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-kube-api-access-ktg2f\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.056065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.056044 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-credential-socket\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157427 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157387 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-podinfo\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157427 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157429 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-token\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157446 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-socket\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157461 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-data\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157484 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istiod-ca-cert\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157499 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktg2f\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-kube-api-access-ktg2f\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157534 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-credential-socket\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157605 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-certs\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.157732 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157654 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-envoy\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.158113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157974 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-socket\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.158113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.157993 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-credential-socket\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.158113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.158039 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-data\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.158113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.158070 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-certs\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.158517 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.158492 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istiod-ca-cert\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.159853 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.159829 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-envoy\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.160053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.160038 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-podinfo\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.166127 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.166104 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktg2f\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-kube-api-access-ktg2f\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.166213 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.166104 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-token\") pod \"e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.238425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.238398 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:56.383380 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.383356 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn"] Jul 02 17:24:56.384892 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:24:56.384865 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee59e843_c651_4ca5_aa62_c9cbaaaaff80.slice/crio-7afec4642f2e727b7f595e967a568407e624e48e2e955171e27fa1b630a36164 WatchSource:0}: Error finding container 7afec4642f2e727b7f595e967a568407e624e48e2e955171e27fa1b630a36164: Status 404 returned error can't find the container with id 7afec4642f2e727b7f595e967a568407e624e48e2e955171e27fa1b630a36164 Jul 02 17:24:56.387075 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.387042 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:24:56.387204 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.387121 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:24:56.387204 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.387165 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:24:56.775175 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.775129 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" event={"ID":"ee59e843-c651-4ca5-aa62-c9cbaaaaff80","Type":"ContainerStarted","Data":"bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802"} Jul 02 17:24:56.775576 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.775191 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" event={"ID":"ee59e843-c651-4ca5-aa62-c9cbaaaaff80","Type":"ContainerStarted","Data":"7afec4642f2e727b7f595e967a568407e624e48e2e955171e27fa1b630a36164"} Jul 02 17:24:56.794972 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:56.794927 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" podStartSLOduration=1.794910234 podStartE2EDuration="1.794910234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:24:56.793345665 +0000 UTC m=+1674.897364208" watchObservedRunningTime="2026-07-02 17:24:56.794910234 +0000 UTC m=+1674.898928839" Jul 02 17:24:57.116188 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.116083 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:57.226854 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.226820 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:57.238815 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.238789 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:57.243489 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.243467 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:57.333368 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.333317 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:57.497126 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.497094 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:57.668478 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.668439 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:57.773008 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.772920 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:24:57.780301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.780268 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:57.781179 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:57.781165 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:24:59.518140 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:24:59.518109 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:02.407573 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:02.407527 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:02.432666 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:02.432624 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn"] Jul 02 17:25:02.433372 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:02.433339 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" podUID="ee59e843-c651-4ca5-aa62-c9cbaaaaff80" containerName="istio-proxy" containerID="cri-o://bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802" gracePeriod=30 Jul 02 17:25:02.475054 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:02.475007 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:02.563836 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:02.563803 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:02.667822 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:02.667728 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:06.164839 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:06.164746 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:07.791877 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.791819 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:25:07.836825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.836789 2535 generic.go:356] "Generic (PLEG): container finished" podID="ee59e843-c651-4ca5-aa62-c9cbaaaaff80" containerID="bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802" exitCode=0 Jul 02 17:25:07.837001 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.836833 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" Jul 02 17:25:07.837001 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.836895 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" event={"ID":"ee59e843-c651-4ca5-aa62-c9cbaaaaff80","Type":"ContainerDied","Data":"bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802"} Jul 02 17:25:07.837001 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.836959 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn" event={"ID":"ee59e843-c651-4ca5-aa62-c9cbaaaaff80","Type":"ContainerDied","Data":"7afec4642f2e727b7f595e967a568407e624e48e2e955171e27fa1b630a36164"} Jul 02 17:25:07.837001 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.836990 2535 scope.go:117] "RemoveContainer" containerID="bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802" Jul 02 17:25:07.845761 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.845742 2535 scope.go:117] "RemoveContainer" containerID="bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802" Jul 02 17:25:07.846022 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:25:07.846005 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802\": container with ID starting with bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802 not found: ID does not exist" containerID="bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802" Jul 02 17:25:07.846072 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.846032 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802"} err="failed to get container status \"bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802\": rpc error: code = NotFound desc = could not find container \"bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802\": container with ID starting with bd760d9a8e4960efef8ec6f7f0e87bcd1d533acc6169e5bfb78e787d445db802 not found: ID does not exist" Jul 02 17:25:07.862092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862071 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-envoy\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862202 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862110 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-certs\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862202 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862128 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-podinfo\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862202 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862147 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktg2f\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-kube-api-access-ktg2f\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862202 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862187 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-socket\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862202 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862202 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-credential-socket\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862234 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-token\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862261 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-data\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862289 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istiod-ca-cert\") pod \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\" (UID: \"ee59e843-c651-4ca5-aa62-c9cbaaaaff80\") " Jul 02 17:25:07.862468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862383 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:07.862707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862552 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.862707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862588 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:07.862816 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862786 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:07.862816 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.862792 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:07.863223 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.863202 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:07.864411 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.864395 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:07.864529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.864511 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:07.864672 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.864655 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:25:07.864745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.864677 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-kube-api-access-ktg2f" (OuterVolumeSpecName: "kube-api-access-ktg2f") pod "ee59e843-c651-4ca5-aa62-c9cbaaaaff80" (UID: "ee59e843-c651-4ca5-aa62-c9cbaaaaff80"). InnerVolumeSpecName "kube-api-access-ktg2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:07.963844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963812 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.963844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963840 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.963844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963850 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.963844 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963858 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.964117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963867 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.964117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963876 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.964117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963884 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:07.964117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:07.963892 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktg2f\" (UniqueName: \"kubernetes.io/projected/ee59e843-c651-4ca5-aa62-c9cbaaaaff80-kube-api-access-ktg2f\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:08.169047 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:08.169016 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn"] Jul 02 17:25:08.179752 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:08.179724 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9fa643a0-openshift-default-5fd5b6875f-89nzn"] Jul 02 17:25:08.389531 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:08.389497 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee59e843-c651-4ca5-aa62-c9cbaaaaff80" path="/var/lib/kubelet/pods/ee59e843-c651-4ca5-aa62-c9cbaaaaff80/volumes" Jul 02 17:25:08.818796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:08.818746 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:08.883269 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:08.883235 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:09.013898 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.013859 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn"] Jul 02 17:25:09.014339 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.014304 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee59e843-c651-4ca5-aa62-c9cbaaaaff80" containerName="istio-proxy" Jul 02 17:25:09.014339 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.014325 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee59e843-c651-4ca5-aa62-c9cbaaaaff80" containerName="istio-proxy" Jul 02 17:25:09.015103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.015075 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee59e843-c651-4ca5-aa62-c9cbaaaaff80" containerName="istio-proxy" Jul 02 17:25:09.024251 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.024222 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.027121 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.027094 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cdcb9ecf-openshift-default-dockercfg-pgc5s\"" Jul 02 17:25:09.035370 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.035340 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn"] Jul 02 17:25:09.060472 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.060440 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:09.074701 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074618 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-token\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074701 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074687 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4096ae79-50ea-43b8-b3f2-4d428d204965-istiod-ca-cert\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074720 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-certs\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074744 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-socket\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074762 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-data\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074802 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zf8k\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-kube-api-access-2zf8k\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074827 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-envoy\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.074874 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074868 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-credential-socket\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.075065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.074883 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-podinfo\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.159082 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.159045 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:09.176106 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176082 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4096ae79-50ea-43b8-b3f2-4d428d204965-istiod-ca-cert\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176233 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176119 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-certs\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176233 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176139 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-socket\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176346 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176231 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-data\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176346 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176254 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zf8k\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-kube-api-access-2zf8k\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176346 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176271 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-envoy\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176346 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176295 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-credential-socket\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176346 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176310 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-podinfo\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176659 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176631 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-certs\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176742 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176642 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-token\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176742 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176712 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-socket\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176858 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176760 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-data\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176858 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176785 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-credential-socket\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.176994 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.176960 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4096ae79-50ea-43b8-b3f2-4d428d204965-istiod-ca-cert\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.178741 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.178720 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-envoy\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.178973 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.178957 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-podinfo\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.184278 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.184259 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-token\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.184717 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.184695 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zf8k\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-kube-api-access-2zf8k\") pod \"e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.336399 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.336303 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:09.476626 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.476600 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn"] Jul 02 17:25:09.477923 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:25:09.477897 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4096ae79_50ea_43b8_b3f2_4d428d204965.slice/crio-83c719168b8dbc3659be3444126a3dede3ca0d7b07cd1209279af922d523a7ef WatchSource:0}: Error finding container 83c719168b8dbc3659be3444126a3dede3ca0d7b07cd1209279af922d523a7ef: Status 404 returned error can't find the container with id 83c719168b8dbc3659be3444126a3dede3ca0d7b07cd1209279af922d523a7ef Jul 02 17:25:09.480044 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.480011 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:09.480143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.480076 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:09.480143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.480104 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:09.853478 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.853334 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" event={"ID":"4096ae79-50ea-43b8-b3f2-4d428d204965","Type":"ContainerStarted","Data":"f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1"} Jul 02 17:25:09.853478 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.853417 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" event={"ID":"4096ae79-50ea-43b8-b3f2-4d428d204965","Type":"ContainerStarted","Data":"83c719168b8dbc3659be3444126a3dede3ca0d7b07cd1209279af922d523a7ef"} Jul 02 17:25:09.876159 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:09.876108 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" podStartSLOduration=1.876092925 podStartE2EDuration="1.876092925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:09.873876653 +0000 UTC m=+1687.977895196" watchObservedRunningTime="2026-07-02 17:25:09.876092925 +0000 UTC m=+1687.980111465" Jul 02 17:25:10.230340 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.230300 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:10.325600 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.325531 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:10.337413 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.337387 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:10.342489 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.342460 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:10.402745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.402713 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:10.498314 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.498213 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:10.775330 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.775244 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:10.859623 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.859590 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:10.860579 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.860561 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:10.875347 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:10.875322 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:12.536824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:12.536788 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:15.439987 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:15.438801 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:15.875395 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:15.875352 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:20.912827 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:20.912733 2535 generic.go:356] "Generic (PLEG): container finished" podID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerID="f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1" exitCode=0 Jul 02 17:25:20.912827 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:20.912805 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" event={"ID":"4096ae79-50ea-43b8-b3f2-4d428d204965","Type":"ContainerDied","Data":"f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1"} Jul 02 17:25:20.913301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:20.913232 2535 scope.go:117] "RemoveContainer" containerID="f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1" Jul 02 17:25:20.914222 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:20.914199 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:20.914282 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:20.914259 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:20.914328 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:20.914289 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:21.783348 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:21.783310 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn"] Jul 02 17:25:21.808910 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:21.808854 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:21.908417 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:21.908386 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:21.919520 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:21.919492 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" event={"ID":"4096ae79-50ea-43b8-b3f2-4d428d204965","Type":"ContainerStarted","Data":"6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d"} Jul 02 17:25:21.919926 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:21.919591 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" containerID="cri-o://6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d" gracePeriod=30 Jul 02 17:25:25.860601 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:25.860515 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:27.175657 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.175630 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:27.238579 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238534 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-token\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.238579 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238583 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-data\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.238797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238618 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4096ae79-50ea-43b8-b3f2-4d428d204965-istiod-ca-cert\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.238797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238653 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-certs\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.238797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238674 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-credential-socket\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.238797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238726 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-podinfo\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.238797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238768 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-envoy\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.239053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238816 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zf8k\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-kube-api-access-2zf8k\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.239053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238858 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-socket\") pod \"4096ae79-50ea-43b8-b3f2-4d428d204965\" (UID: \"4096ae79-50ea-43b8-b3f2-4d428d204965\") " Jul 02 17:25:27.239053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.238963 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:27.239053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239015 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:27.239247 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239059 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4096ae79-50ea-43b8-b3f2-4d428d204965-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:27.239247 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239162 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4096ae79-50ea-43b8-b3f2-4d428d204965-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.239349 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239271 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.239349 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239273 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:27.239349 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239288 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.239678 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.239652 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-data" (OuterVolumeSpecName: "istio-data") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:27.240846 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.240824 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-token" (OuterVolumeSpecName: "istio-token") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:27.240961 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.240949 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-kube-api-access-2zf8k" (OuterVolumeSpecName: "kube-api-access-2zf8k") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "kube-api-access-2zf8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:27.241243 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.241221 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:27.241243 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.241233 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4096ae79-50ea-43b8-b3f2-4d428d204965" (UID: "4096ae79-50ea-43b8-b3f2-4d428d204965"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:25:27.339881 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.339855 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.339881 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.339878 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.339881 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.339887 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.340087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.339895 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.340087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.339903 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4096ae79-50ea-43b8-b3f2-4d428d204965-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.340087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.339911 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zf8k\" (UniqueName: \"kubernetes.io/projected/4096ae79-50ea-43b8-b3f2-4d428d204965-kube-api-access-2zf8k\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:27.681501 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.681394 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:27.781455 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.781415 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:27.852129 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.852101 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc"] Jul 02 17:25:27.852513 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.852498 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" Jul 02 17:25:27.852571 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.852517 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" Jul 02 17:25:27.852611 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.852605 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" Jul 02 17:25:27.852649 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.852614 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" Jul 02 17:25:27.854693 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.854676 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.857631 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.857612 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2dda51e2-openshift-default-dockercfg-n29dz\"" Jul 02 17:25:27.869671 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.869649 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc"] Jul 02 17:25:27.884416 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.884369 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:27.944915 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.944844 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-certs\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.944915 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.944875 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-envoy\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.944919 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-data\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.944973 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95e02ca-7a20-4a48-a952-65c13bd7a248-istiod-ca-cert\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.945014 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-podinfo\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.945030 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-token\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.945048 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-socket\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945091 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.945065 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-kube-api-access-7pvxk\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.945344 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.945183 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-credential-socket\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:27.954073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.954038 2535 generic.go:356] "Generic (PLEG): container finished" podID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerID="6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d" exitCode=0 Jul 02 17:25:27.954215 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.954089 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" Jul 02 17:25:27.954215 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.954111 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" event={"ID":"4096ae79-50ea-43b8-b3f2-4d428d204965","Type":"ContainerDied","Data":"6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d"} Jul 02 17:25:27.954215 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.954154 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn" event={"ID":"4096ae79-50ea-43b8-b3f2-4d428d204965","Type":"ContainerDied","Data":"83c719168b8dbc3659be3444126a3dede3ca0d7b07cd1209279af922d523a7ef"} Jul 02 17:25:27.954215 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.954180 2535 scope.go:117] "RemoveContainer" containerID="6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d" Jul 02 17:25:27.963867 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.963849 2535 scope.go:117] "RemoveContainer" containerID="f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1" Jul 02 17:25:27.971630 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.971607 2535 scope.go:117] "RemoveContainer" containerID="6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d" Jul 02 17:25:27.971870 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:25:27.971851 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d\": container with ID starting with 6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d not found: ID does not exist" containerID="6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d" Jul 02 17:25:27.971917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.971878 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d"} err="failed to get container status \"6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d\": rpc error: code = NotFound desc = could not find container \"6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d\": container with ID starting with 6c8fd7e468ce7be340768891389dcf9fb63cbffd41f532f1ee6885aa611f8c4d not found: ID does not exist" Jul 02 17:25:27.971917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.971895 2535 scope.go:117] "RemoveContainer" containerID="f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1" Jul 02 17:25:27.972137 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:25:27.972119 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1\": container with ID starting with f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1 not found: ID does not exist" containerID="f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1" Jul 02 17:25:27.972187 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.972141 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1"} err="failed to get container status \"f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1\": rpc error: code = NotFound desc = could not find container \"f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1\": container with ID starting with f6b0061eae295d8f54dd01229a90bfa113ba05bc11450b1196417a2a1215a5a1 not found: ID does not exist" Jul 02 17:25:27.976569 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.976531 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn"] Jul 02 17:25:27.981204 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:27.981184 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cdcb9ecf-openshift-default-7b4f754b57-b4gzn"] Jul 02 17:25:28.046024 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046001 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-podinfo\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046029 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-token\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046054 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-socket\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046078 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-kube-api-access-7pvxk\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046141 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-credential-socket\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046184 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-certs\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046210 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-envoy\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046260 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-data\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046465 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046295 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95e02ca-7a20-4a48-a952-65c13bd7a248-istiod-ca-cert\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046465 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046455 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-socket\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046603 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046578 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-credential-socket\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046666 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046641 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-certs\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046790 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046771 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-data\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.046951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.046934 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95e02ca-7a20-4a48-a952-65c13bd7a248-istiod-ca-cert\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.048341 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.048323 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-envoy\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.048597 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.048581 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-podinfo\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.053807 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.053783 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-kube-api-access-7pvxk\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.053892 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.053849 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-token\") pod \"e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.164757 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.164730 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:28.303328 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.303302 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc"] Jul 02 17:25:28.305176 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:25:28.305143 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95e02ca_7a20_4a48_a952_65c13bd7a248.slice/crio-8b511fb3d7c692cef2d28eb420ee5321313bdedf80b148e90e9ddf2beeb83ce9 WatchSource:0}: Error finding container 8b511fb3d7c692cef2d28eb420ee5321313bdedf80b148e90e9ddf2beeb83ce9: Status 404 returned error can't find the container with id 8b511fb3d7c692cef2d28eb420ee5321313bdedf80b148e90e9ddf2beeb83ce9 Jul 02 17:25:28.307439 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.307410 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:28.307508 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.307474 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:28.307508 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.307502 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:25:28.390267 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.390237 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" path="/var/lib/kubelet/pods/4096ae79-50ea-43b8-b3f2-4d428d204965/volumes" Jul 02 17:25:28.862231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.862198 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:28.961898 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.961866 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:28.962895 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.962869 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" event={"ID":"a95e02ca-7a20-4a48-a952-65c13bd7a248","Type":"ContainerStarted","Data":"dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4"} Jul 02 17:25:28.962983 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.962917 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" event={"ID":"a95e02ca-7a20-4a48-a952-65c13bd7a248","Type":"ContainerStarted","Data":"8b511fb3d7c692cef2d28eb420ee5321313bdedf80b148e90e9ddf2beeb83ce9"} Jul 02 17:25:28.996799 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:28.996754 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" podStartSLOduration=1.996740112 podStartE2EDuration="1.996740112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:28.996087619 +0000 UTC m=+1707.100106163" watchObservedRunningTime="2026-07-02 17:25:28.996740112 +0000 UTC m=+1707.100758654" Jul 02 17:25:29.113747 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.113667 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:29.165465 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.165433 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:29.170394 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.170369 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:29.195019 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.194985 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:29.270897 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.270867 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:29.469852 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.469816 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:29.718067 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.718028 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:29.816982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.816885 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:29.967700 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.967669 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:29.968627 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:29.968609 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:32.238002 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:32.237964 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:33.558458 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:33.558421 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:33.739447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:33.738097 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc"] Jul 02 17:25:33.739447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:33.738411 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" podUID="a95e02ca-7a20-4a48-a952-65c13bd7a248" containerName="istio-proxy" containerID="cri-o://dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4" gracePeriod=30 Jul 02 17:25:33.754694 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:33.754647 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:33.871231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:33.871136 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:33.973575 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:33.973521 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:35.782495 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:35.782465 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:35.890882 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:35.890847 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:39.491776 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.491724 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:39.558799 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.558721 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:39.645777 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645744 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-token\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.645942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645787 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-credential-socket\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.645942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645824 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-podinfo\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.645942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645847 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-envoy\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.645942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645890 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95e02ca-7a20-4a48-a952-65c13bd7a248-istiod-ca-cert\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.645942 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645935 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-certs\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.646230 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.645962 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-data\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.646230 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646017 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-kube-api-access-7pvxk\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.646230 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646040 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-socket\") pod \"a95e02ca-7a20-4a48-a952-65c13bd7a248\" (UID: \"a95e02ca-7a20-4a48-a952-65c13bd7a248\") " Jul 02 17:25:39.646230 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646167 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:39.646488 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646341 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:39.646488 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646355 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.646488 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646407 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a95e02ca-7a20-4a48-a952-65c13bd7a248-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:25:39.646927 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.646901 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:39.647185 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.647155 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-data" (OuterVolumeSpecName: "istio-data") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:39.648126 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.648098 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-token" (OuterVolumeSpecName: "istio-token") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:39.648224 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.648133 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:25:39.648224 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.648139 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:25:39.648340 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.648323 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-kube-api-access-7pvxk" (OuterVolumeSpecName: "kube-api-access-7pvxk") pod "a95e02ca-7a20-4a48-a952-65c13bd7a248" (UID: "a95e02ca-7a20-4a48-a952-65c13bd7a248"). InnerVolumeSpecName "kube-api-access-7pvxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:25:39.659185 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.659160 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:39.746927 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746900 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.746927 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746923 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.746927 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746932 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.747134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746942 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a95e02ca-7a20-4a48-a952-65c13bd7a248-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.747134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746951 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.747134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746959 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.747134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746966 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/a95e02ca-7a20-4a48-a952-65c13bd7a248-kube-api-access-7pvxk\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:39.747134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:39.746975 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a95e02ca-7a20-4a48-a952-65c13bd7a248-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:25:40.024252 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.024213 2535 generic.go:356] "Generic (PLEG): container finished" podID="a95e02ca-7a20-4a48-a952-65c13bd7a248" containerID="dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4" exitCode=0 Jul 02 17:25:40.024252 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.024255 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" Jul 02 17:25:40.024475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.024296 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" event={"ID":"a95e02ca-7a20-4a48-a952-65c13bd7a248","Type":"ContainerDied","Data":"dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4"} Jul 02 17:25:40.024475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.024351 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc" event={"ID":"a95e02ca-7a20-4a48-a952-65c13bd7a248","Type":"ContainerDied","Data":"8b511fb3d7c692cef2d28eb420ee5321313bdedf80b148e90e9ddf2beeb83ce9"} Jul 02 17:25:40.024475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.024374 2535 scope.go:117] "RemoveContainer" containerID="dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4" Jul 02 17:25:40.035711 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.035691 2535 scope.go:117] "RemoveContainer" containerID="dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4" Jul 02 17:25:40.035975 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:25:40.035957 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4\": container with ID starting with dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4 not found: ID does not exist" containerID="dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4" Jul 02 17:25:40.036034 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.035983 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4"} err="failed to get container status \"dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4\": rpc error: code = NotFound desc = could not find container \"dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4\": container with ID starting with dd2f42b8632849ee7a100e73b5238b421f94c9f939f8489dc69d3b9a162952c4 not found: ID does not exist" Jul 02 17:25:40.046152 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.046129 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:40.053026 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.053004 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc"] Jul 02 17:25:40.064439 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.064406 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2dda51e2-openshift-default-69f4946475-86dvc"] Jul 02 17:25:40.145564 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.145506 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:40.244778 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.244746 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:40.389849 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:40.389774 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95e02ca-7a20-4a48-a952-65c13bd7a248" path="/var/lib/kubelet/pods/a95e02ca-7a20-4a48-a952-65c13bd7a248/volumes" Jul 02 17:25:46.654877 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:46.654828 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:52.392825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:52.392787 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:52.456031 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:52.455990 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:52.534834 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:52.534803 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:52.634158 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:52.634122 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:52.734599 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:52.734565 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:25:53.167005 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:25:53.166915 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:06.525922 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:06.525877 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:06.628623 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:06.628584 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:19.227410 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:19.227369 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:25.126628 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:25.126591 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:25.237415 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:25.237383 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:25.331769 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:25.331726 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:41.334705 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:41.334670 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:47.562346 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:47.562305 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:47.630637 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:47.630596 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:47.718335 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:47.718297 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:47.818329 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:47.818246 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:58.343293 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:58.343207 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:26:59.199134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:26:59.199093 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:02.449965 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:02.449933 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:27:02.456324 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:02.456298 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:27:02.457332 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:02.457302 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:27:02.463064 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:02.463047 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:27:04.991913 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:04.991874 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:05.056172 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:05.056135 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:05.158384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:05.158332 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:05.248451 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:05.248359 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:05.347712 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:05.347676 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:06.512841 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:06.512801 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:12.353366 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:12.353334 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:12.429572 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:12.429527 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:12.523223 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:12.523187 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:12.623170 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:12.623087 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:13.478184 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:13.478146 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:13.584963 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:13.584918 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:13.678143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:13.678102 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:15.306275 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:15.306238 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:21.083799 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:21.083757 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:21.137633 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:21.137601 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:21.814793 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:21.814764 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:27.733440 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:27.733407 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:27.823039 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:27.823004 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:27.991359 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:27.991271 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:28.301969 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.301895 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk"] Jul 02 17:27:28.302245 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.302233 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" Jul 02 17:27:28.302292 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.302247 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="4096ae79-50ea-43b8-b3f2-4d428d204965" containerName="istio-proxy" Jul 02 17:27:28.302292 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.302255 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95e02ca-7a20-4a48-a952-65c13bd7a248" containerName="istio-proxy" Jul 02 17:27:28.302292 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.302260 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95e02ca-7a20-4a48-a952-65c13bd7a248" containerName="istio-proxy" Jul 02 17:27:28.302397 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.302309 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95e02ca-7a20-4a48-a952-65c13bd7a248" containerName="istio-proxy" Jul 02 17:27:28.304214 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.304195 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.306491 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.306465 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-af630ed9-openshift-default-dockercfg-dlgdw\"" Jul 02 17:27:28.340612 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.340583 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk"] Jul 02 17:27:28.351323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.351294 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:28.441867 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.441835 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-envoy\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.441867 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.441869 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-socket\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.441904 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-credential-socket\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.441946 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10453bf5-6509-44f1-aa4f-40bc7229c300-istiod-ca-cert\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.441999 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8kxq\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-kube-api-access-q8kxq\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.442062 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-token\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442236 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.442114 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-podinfo\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442236 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.442191 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-data\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.442236 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.442219 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-certs\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.543734 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.543686 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-token\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.543916 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.543754 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-podinfo\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.543916 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.543806 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-data\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.543916 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.543835 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-certs\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544089 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.543970 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-envoy\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544089 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544022 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-socket\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544201 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544092 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-credential-socket\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544201 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544131 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10453bf5-6509-44f1-aa4f-40bc7229c300-istiod-ca-cert\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544201 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544172 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8kxq\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-kube-api-access-q8kxq\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544352 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544219 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-data\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544408 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544366 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-certs\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544569 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-credential-socket\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544697 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544646 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-socket\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.544862 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.544843 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10453bf5-6509-44f1-aa4f-40bc7229c300-istiod-ca-cert\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.546270 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.546193 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:28.546385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.546335 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-envoy\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.546858 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.546836 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-podinfo\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.554728 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.554671 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8kxq\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-kube-api-access-q8kxq\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.554834 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.554739 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-token\") pod \"e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.614187 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.614150 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:28.751333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.751308 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk"] Jul 02 17:27:28.753886 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:27:28.753854 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10453bf5_6509_44f1_aa4f_40bc7229c300.slice/crio-8ad3f89e8ddaf2a19f6f18a02958c8070787df7f484b4e5e9314a5a32fece8ee WatchSource:0}: Error finding container 8ad3f89e8ddaf2a19f6f18a02958c8070787df7f484b4e5e9314a5a32fece8ee: Status 404 returned error can't find the container with id 8ad3f89e8ddaf2a19f6f18a02958c8070787df7f484b4e5e9314a5a32fece8ee Jul 02 17:27:28.755993 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.755961 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:28.756085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.756024 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:28.756085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:28.756051 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:29.580643 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:29.580608 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" event={"ID":"10453bf5-6509-44f1-aa4f-40bc7229c300","Type":"ContainerStarted","Data":"f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f"} Jul 02 17:27:29.580815 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:29.580661 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" event={"ID":"10453bf5-6509-44f1-aa4f-40bc7229c300","Type":"ContainerStarted","Data":"8ad3f89e8ddaf2a19f6f18a02958c8070787df7f484b4e5e9314a5a32fece8ee"} Jul 02 17:27:29.604105 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:29.604059 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" podStartSLOduration=1.604044895 podStartE2EDuration="1.604044895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:27:29.601920591 +0000 UTC m=+1827.705939143" watchObservedRunningTime="2026-07-02 17:27:29.604044895 +0000 UTC m=+1827.708063436" Jul 02 17:27:29.614889 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:29.614859 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:29.619748 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:29.619726 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:30.585597 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:30.585570 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:30.586497 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:30.586474 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:31.656331 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:31.656294 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:31.761923 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:31.761884 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:31.868980 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:31.868948 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:32.315162 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:32.315124 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:32.415789 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:32.415750 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:32.519081 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:32.519045 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:36.185730 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:36.185699 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:36.891326 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:36.891291 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:36.981253 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:36.981201 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:37.312809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:37.312762 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:43.094750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:43.094712 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:43.158974 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:43.158937 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:43.492513 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:43.492477 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:43.819593 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:43.819563 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:43.921006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:43.920949 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:44.673830 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:44.673800 2535 generic.go:356] "Generic (PLEG): container finished" podID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerID="f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f" exitCode=0 Jul 02 17:27:44.674194 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:44.673868 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" event={"ID":"10453bf5-6509-44f1-aa4f-40bc7229c300","Type":"ContainerDied","Data":"f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f"} Jul 02 17:27:44.674239 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:44.674227 2535 scope.go:117] "RemoveContainer" containerID="f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f" Jul 02 17:27:44.675300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:44.675277 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:44.675359 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:44.675341 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:44.675402 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:44.675380 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:27:45.585701 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:45.585667 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:45.681065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:45.681033 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" event={"ID":"10453bf5-6509-44f1-aa4f-40bc7229c300","Type":"ContainerStarted","Data":"15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897"} Jul 02 17:27:46.614361 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:46.614334 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:46.615587 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:46.615560 2535 patch_prober.go:28] interesting pod/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 02 17:27:46.615697 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:46.615608 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 02 17:27:47.614450 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:47.614415 2535 patch_prober.go:28] interesting pod/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 02 17:27:47.614826 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:47.614466 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 02 17:27:48.614603 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:48.614557 2535 patch_prober.go:28] interesting pod/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 02 17:27:48.614986 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:48.614628 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 02 17:27:49.626697 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.626668 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:49.627149 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.626954 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:49.627588 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.627569 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:49.703323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.703265 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:49.763761 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.763718 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:49.945317 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.945240 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk"] Jul 02 17:27:49.969888 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:49.969856 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:50.187425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:50.187391 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:50.326048 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:50.326020 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:50.413999 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:50.413960 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:50.561336 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:50.561296 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:50.706135 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:50.706107 2535 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" secret="" err="secret \"e2e-mt-af630ed9-openshift-default-dockercfg-dlgdw\" not found" Jul 02 17:27:51.710583 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:51.710504 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" containerID="cri-o://15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897" gracePeriod=30 Jul 02 17:27:56.294566 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:56.294503 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:56.352814 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:56.352781 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:56.443168 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:56.443117 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:56.544329 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:56.544291 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:56.644027 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:56.643947 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:27:56.971236 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:56.971215 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:57.006838 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.006812 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-podinfo\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.006860 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-certs\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.006900 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10453bf5-6509-44f1-aa4f-40bc7229c300-istiod-ca-cert\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.006947 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-credential-socket\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.006978 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-socket\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007020 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8kxq\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-kube-api-access-q8kxq\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007041 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-token\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007078 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-envoy\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007109 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-data\") pod \"10453bf5-6509-44f1-aa4f-40bc7229c300\" (UID: \"10453bf5-6509-44f1-aa4f-40bc7229c300\") " Jul 02 17:27:57.007425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007229 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:57.007425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007248 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:57.007425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007332 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10453bf5-6509-44f1-aa4f-40bc7229c300-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:27:57.007592 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007424 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.007592 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007442 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10453bf5-6509-44f1-aa4f-40bc7229c300-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.007592 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007455 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.007872 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.007839 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:57.008150 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.008125 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-data" (OuterVolumeSpecName: "istio-data") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:57.009275 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.009245 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:27:57.009363 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.009271 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:27:57.009814 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.009791 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-token" (OuterVolumeSpecName: "istio-token") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:27:57.009887 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.009808 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-kube-api-access-q8kxq" (OuterVolumeSpecName: "kube-api-access-q8kxq") pod "10453bf5-6509-44f1-aa4f-40bc7229c300" (UID: "10453bf5-6509-44f1-aa4f-40bc7229c300"). InnerVolumeSpecName "kube-api-access-q8kxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:27:57.108265 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.108231 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.108265 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.108257 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.108265 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.108266 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.108265 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.108275 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10453bf5-6509-44f1-aa4f-40bc7229c300-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.108524 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.108285 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8kxq\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-kube-api-access-q8kxq\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.108524 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.108293 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10453bf5-6509-44f1-aa4f-40bc7229c300-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:27:57.741282 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.741251 2535 generic.go:356] "Generic (PLEG): container finished" podID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerID="15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897" exitCode=0 Jul 02 17:27:57.741751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.741296 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" Jul 02 17:27:57.741751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.741336 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" event={"ID":"10453bf5-6509-44f1-aa4f-40bc7229c300","Type":"ContainerDied","Data":"15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897"} Jul 02 17:27:57.741751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.741403 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk" event={"ID":"10453bf5-6509-44f1-aa4f-40bc7229c300","Type":"ContainerDied","Data":"8ad3f89e8ddaf2a19f6f18a02958c8070787df7f484b4e5e9314a5a32fece8ee"} Jul 02 17:27:57.741751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.741438 2535 scope.go:117] "RemoveContainer" containerID="15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897" Jul 02 17:27:57.750996 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.750982 2535 scope.go:117] "RemoveContainer" containerID="f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f" Jul 02 17:27:57.759124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.759108 2535 scope.go:117] "RemoveContainer" containerID="15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897" Jul 02 17:27:57.759359 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:27:57.759341 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897\": container with ID starting with 15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897 not found: ID does not exist" containerID="15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897" Jul 02 17:27:57.759418 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.759368 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897"} err="failed to get container status \"15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897\": rpc error: code = NotFound desc = could not find container \"15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897\": container with ID starting with 15e52287e3efb1307a04c0e594ee435490a7f01d3d149440bdf92ee968010897 not found: ID does not exist" Jul 02 17:27:57.759418 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.759385 2535 scope.go:117] "RemoveContainer" containerID="f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f" Jul 02 17:27:57.759608 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:27:57.759587 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f\": container with ID starting with f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f not found: ID does not exist" containerID="f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f" Jul 02 17:27:57.759671 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.759617 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f"} err="failed to get container status \"f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f\": rpc error: code = NotFound desc = could not find container \"f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f\": container with ID starting with f728a0dc8be5f5d9882325887839f44bf8774a017fbd58fe46e8334e4fdaac0f not found: ID does not exist" Jul 02 17:27:57.763749 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.763726 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk"] Jul 02 17:27:57.766565 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:57.766523 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-af630ed9-openshift-default-7cf5cf4487-vb5vk"] Jul 02 17:27:58.396006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:27:58.395973 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" path="/var/lib/kubelet/pods/10453bf5-6509-44f1-aa4f-40bc7229c300/volumes" Jul 02 17:28:02.348580 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:02.348528 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:02.411362 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:02.411329 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:08.832189 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:08.832136 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:09.119343 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.119255 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc"] Jul 02 17:28:09.119626 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.119610 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" Jul 02 17:28:09.119626 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.119625 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" Jul 02 17:28:09.119750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.119636 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" Jul 02 17:28:09.119750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.119641 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" Jul 02 17:28:09.119750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.119704 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" Jul 02 17:28:09.121838 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.121818 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.124170 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.124149 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ca038502-openshift-default-dockercfg-w6csz\"" Jul 02 17:28:09.133688 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.133661 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc"] Jul 02 17:28:09.156273 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.156215 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:09.218349 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218312 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbszt\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-kube-api-access-zbszt\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218360 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-token\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218422 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-data\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218466 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-socket\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218495 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-envoy\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218520 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-podinfo\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218582 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istiod-ca-cert\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218685 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-credential-socket\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.218796 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.218726 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-certs\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.251589 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.251530 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:09.319429 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319363 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-socket\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319446 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-envoy\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319468 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-podinfo\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319565 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istiod-ca-cert\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319660 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319632 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-credential-socket\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319887 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319763 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-certs\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319887 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319839 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbszt\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-kube-api-access-zbszt\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.319887 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319867 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-token\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.320050 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.319914 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-data\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.320316 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.320293 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-socket\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.320426 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.320399 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istiod-ca-cert\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.320701 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.320678 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-data\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.320805 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.320747 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-certs\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.320916 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.320895 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-credential-socket\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.322069 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.322046 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-envoy\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.322186 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.322173 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-podinfo\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.328197 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.328175 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-token\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.328351 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.328332 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbszt\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-kube-api-access-zbszt\") pod \"e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.434768 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.434690 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:09.578770 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.578741 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc"] Jul 02 17:28:09.580154 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:28:09.580127 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94310390_5c35_4bb3_98a5_95a6b4e6d8ea.slice/crio-0e81235f2f800fccbaeb2e6dc1e92d6c71f444d05f80484b034cecfc64f4cdca WatchSource:0}: Error finding container 0e81235f2f800fccbaeb2e6dc1e92d6c71f444d05f80484b034cecfc64f4cdca: Status 404 returned error can't find the container with id 0e81235f2f800fccbaeb2e6dc1e92d6c71f444d05f80484b034cecfc64f4cdca Jul 02 17:28:09.582185 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.582155 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:09.582262 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.582220 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:09.582262 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.582245 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:09.805384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.805347 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" event={"ID":"94310390-5c35-4bb3-98a5-95a6b4e6d8ea","Type":"ContainerStarted","Data":"dbfc38cd1df0480c80d88a4fb1117a1bdffde180f2d928a9b1c3016f0d7f2b22"} Jul 02 17:28:09.805613 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.805407 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" event={"ID":"94310390-5c35-4bb3-98a5-95a6b4e6d8ea","Type":"ContainerStarted","Data":"0e81235f2f800fccbaeb2e6dc1e92d6c71f444d05f80484b034cecfc64f4cdca"} Jul 02 17:28:09.825062 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:09.824997 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podStartSLOduration=0.824976639 podStartE2EDuration="824.976639ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:28:09.823752092 +0000 UTC m=+1867.927770639" watchObservedRunningTime="2026-07-02 17:28:09.824976639 +0000 UTC m=+1867.928995182" Jul 02 17:28:10.435069 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:10.435042 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:10.439957 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:10.439932 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:10.810373 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:10.810335 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:10.811270 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:10.811249 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:11.865029 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:11.864992 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:11.961013 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:11.960979 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:12.069945 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:12.069906 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:12.293456 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:12.293418 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:12.615213 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:12.615116 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:12.717092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:12.717053 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:15.440474 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:15.440431 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:15.538824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:15.538785 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:16.346512 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:16.346475 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:25.811976 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.811939 2535 patch_prober.go:28] interesting pod/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 02 17:28:25.812391 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.812006 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 02 17:28:25.892637 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.892602 2535 generic.go:356] "Generic (PLEG): container finished" podID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerID="dbfc38cd1df0480c80d88a4fb1117a1bdffde180f2d928a9b1c3016f0d7f2b22" exitCode=0 Jul 02 17:28:25.892801 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.892676 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" event={"ID":"94310390-5c35-4bb3-98a5-95a6b4e6d8ea","Type":"ContainerDied","Data":"dbfc38cd1df0480c80d88a4fb1117a1bdffde180f2d928a9b1c3016f0d7f2b22"} Jul 02 17:28:25.893085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.893071 2535 scope.go:117] "RemoveContainer" containerID="dbfc38cd1df0480c80d88a4fb1117a1bdffde180f2d928a9b1c3016f0d7f2b22" Jul 02 17:28:25.894078 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.894051 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:25.894171 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.894134 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:25.894238 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:25.894181 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:28:26.899705 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:26.899664 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" event={"ID":"94310390-5c35-4bb3-98a5-95a6b4e6d8ea","Type":"ContainerStarted","Data":"3e6a2e1485125c84e293ee9b5095696d9c7d354092243b8bc0fb589eb64f2f4b"} Jul 02 17:28:27.435693 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:27.435659 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:27.436062 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:27.435973 2535 patch_prober.go:28] interesting pod/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 02 17:28:27.436233 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:27.436210 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 02 17:28:28.435741 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:28.435696 2535 patch_prober.go:28] interesting pod/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 02 17:28:28.436330 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:28.435780 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 02 17:28:29.435917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:29.435873 2535 patch_prober.go:28] interesting pod/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 02 17:28:29.436394 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:29.435941 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 02 17:28:30.111170 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:30.111130 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:30.435725 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:30.435622 2535 patch_prober.go:28] interesting pod/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 02 17:28:30.435725 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:30.435703 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 02 17:28:31.439210 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:31.439179 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:31.439616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:31.439566 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:31.440202 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:31.440184 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:28:33.900526 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:33.900487 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:34.002435 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:34.002392 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:53.804245 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:53.804212 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:54.132284 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:54.132184 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:28:59.874198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:28:59.874158 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:04.908217 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:04.908173 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:25.981824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:25.981789 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:41.246800 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:41.246765 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:41.825597 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:41.825559 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:47.480310 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:47.480278 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:52.961448 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:52.961408 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:53.062387 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:53.062345 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:53.239436 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:53.239363 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc"] Jul 02 17:29:53.239590 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:53.239562 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" containerID="cri-o://3e6a2e1485125c84e293ee9b5095696d9c7d354092243b8bc0fb589eb64f2f4b" gracePeriod=30 Jul 02 17:29:53.266069 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:53.261658 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:53.518128 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:53.518035 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:54.588672 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:54.588580 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:54.688106 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:54.688072 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:54.785664 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:54.785638 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:55.520799 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:55.520765 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:55.621094 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:55.621048 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:55.721508 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:55.721469 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:57.099324 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:57.099266 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:29:58.368596 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.368566 2535 generic.go:356] "Generic (PLEG): container finished" podID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerID="3e6a2e1485125c84e293ee9b5095696d9c7d354092243b8bc0fb589eb64f2f4b" exitCode=0 Jul 02 17:29:58.368982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.368568 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" event={"ID":"94310390-5c35-4bb3-98a5-95a6b4e6d8ea","Type":"ContainerDied","Data":"3e6a2e1485125c84e293ee9b5095696d9c7d354092243b8bc0fb589eb64f2f4b"} Jul 02 17:29:58.368982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.368714 2535 scope.go:117] "RemoveContainer" containerID="dbfc38cd1df0480c80d88a4fb1117a1bdffde180f2d928a9b1c3016f0d7f2b22" Jul 02 17:29:58.498064 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.498003 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:29:58.548442 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548405 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-token\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548442 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548456 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-certs\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548515 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-envoy\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548565 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-data\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548598 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbszt\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-kube-api-access-zbszt\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548629 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istiod-ca-cert\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548711 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-podinfo\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548907 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548734 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-credential-socket\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548907 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548761 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-socket\") pod \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\" (UID: \"94310390-5c35-4bb3-98a5-95a6b4e6d8ea\") " Jul 02 17:29:58.548907 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.548776 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:58.549078 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549064 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:29:58.549233 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549213 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:58.549479 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549453 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.549479 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549465 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:58.549651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549484 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.549651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549500 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.549651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.549622 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:58.551004 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.550960 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:29:58.551324 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.551294 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:29:58.551437 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.551348 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-kube-api-access-zbszt" (OuterVolumeSpecName: "kube-api-access-zbszt") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "kube-api-access-zbszt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:29:58.551688 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.551671 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "94310390-5c35-4bb3-98a5-95a6b4e6d8ea" (UID: "94310390-5c35-4bb3-98a5-95a6b4e6d8ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:29:58.650312 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.650275 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.650312 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.650306 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.650312 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.650316 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.650633 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.650326 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.650633 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.650335 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:58.650633 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:58.650342 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbszt\" (UniqueName: \"kubernetes.io/projected/94310390-5c35-4bb3-98a5-95a6b4e6d8ea-kube-api-access-zbszt\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:29:59.375082 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:59.375049 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" event={"ID":"94310390-5c35-4bb3-98a5-95a6b4e6d8ea","Type":"ContainerDied","Data":"0e81235f2f800fccbaeb2e6dc1e92d6c71f444d05f80484b034cecfc64f4cdca"} Jul 02 17:29:59.375082 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:59.375075 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc" Jul 02 17:29:59.375628 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:59.375106 2535 scope.go:117] "RemoveContainer" containerID="3e6a2e1485125c84e293ee9b5095696d9c7d354092243b8bc0fb589eb64f2f4b" Jul 02 17:29:59.398423 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:59.398384 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc"] Jul 02 17:29:59.401879 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:29:59.401845 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ca038502-openshift-default-766889b4bc-q7bhc"] Jul 02 17:30:00.140598 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.140561 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29716890-5vmvv"] Jul 02 17:30:00.140913 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.140900 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" Jul 02 17:30:00.140967 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.140915 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" Jul 02 17:30:00.141002 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.140993 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" Jul 02 17:30:00.141036 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.141003 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="10453bf5-6509-44f1-aa4f-40bc7229c300" containerName="istio-proxy" Jul 02 17:30:00.145191 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.145172 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:00.147392 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.147369 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cq75x\"" Jul 02 17:30:00.153825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.153801 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716890-5vmvv"] Jul 02 17:30:00.165008 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.164980 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjz6\" (UniqueName: \"kubernetes.io/projected/a04bc0f1-a395-4302-9192-e96b0fc06041-kube-api-access-psjz6\") pod \"maas-api-key-cleanup-29716890-5vmvv\" (UID: \"a04bc0f1-a395-4302-9192-e96b0fc06041\") " pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:00.267938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.267891 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjz6\" (UniqueName: \"kubernetes.io/projected/a04bc0f1-a395-4302-9192-e96b0fc06041-kube-api-access-psjz6\") pod \"maas-api-key-cleanup-29716890-5vmvv\" (UID: \"a04bc0f1-a395-4302-9192-e96b0fc06041\") " pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:00.277182 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.277151 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjz6\" (UniqueName: \"kubernetes.io/projected/a04bc0f1-a395-4302-9192-e96b0fc06041-kube-api-access-psjz6\") pod \"maas-api-key-cleanup-29716890-5vmvv\" (UID: \"a04bc0f1-a395-4302-9192-e96b0fc06041\") " pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:00.388715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.388683 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" path="/var/lib/kubelet/pods/94310390-5c35-4bb3-98a5-95a6b4e6d8ea/volumes" Jul 02 17:30:00.456532 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.456502 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:00.587745 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:00.587712 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716890-5vmvv"] Jul 02 17:30:00.590394 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:30:00.590366 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04bc0f1_a395_4302_9192_e96b0fc06041.slice/crio-261cf188ad25d0bda6bf587e4cfdbdfb90cb188c56774e870e5a5f16881e0f75 WatchSource:0}: Error finding container 261cf188ad25d0bda6bf587e4cfdbdfb90cb188c56774e870e5a5f16881e0f75: Status 404 returned error can't find the container with id 261cf188ad25d0bda6bf587e4cfdbdfb90cb188c56774e870e5a5f16881e0f75 Jul 02 17:30:01.388616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:01.388574 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" event={"ID":"a04bc0f1-a395-4302-9192-e96b0fc06041","Type":"ContainerStarted","Data":"4aeaa58b65f6b2e1b7681fc2ee00fb354689793eb158939a92287cb2c7d55b7f"} Jul 02 17:30:01.388777 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:01.388625 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" event={"ID":"a04bc0f1-a395-4302-9192-e96b0fc06041","Type":"ContainerStarted","Data":"261cf188ad25d0bda6bf587e4cfdbdfb90cb188c56774e870e5a5f16881e0f75"} Jul 02 17:30:01.404455 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:01.404401 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" podStartSLOduration=1.404386722 podStartE2EDuration="1.404386722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:30:01.402473938 +0000 UTC m=+1979.506492479" watchObservedRunningTime="2026-07-02 17:30:01.404386722 +0000 UTC m=+1979.508405263" Jul 02 17:30:02.394706 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:02.394672 2535 generic.go:356] "Generic (PLEG): container finished" podID="a04bc0f1-a395-4302-9192-e96b0fc06041" containerID="4aeaa58b65f6b2e1b7681fc2ee00fb354689793eb158939a92287cb2c7d55b7f" exitCode=0 Jul 02 17:30:02.395089 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:02.394747 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" event={"ID":"a04bc0f1-a395-4302-9192-e96b0fc06041","Type":"ContainerDied","Data":"4aeaa58b65f6b2e1b7681fc2ee00fb354689793eb158939a92287cb2c7d55b7f"} Jul 02 17:30:02.903825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:02.903730 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:03.009051 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:03.009008 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:03.530156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:03.530132 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:03.582484 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:03.582447 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:03.598723 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:03.598696 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psjz6\" (UniqueName: \"kubernetes.io/projected/a04bc0f1-a395-4302-9192-e96b0fc06041-kube-api-access-psjz6\") pod \"a04bc0f1-a395-4302-9192-e96b0fc06041\" (UID: \"a04bc0f1-a395-4302-9192-e96b0fc06041\") " Jul 02 17:30:03.600791 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:03.600769 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a04bc0f1-a395-4302-9192-e96b0fc06041-kube-api-access-psjz6" (OuterVolumeSpecName: "kube-api-access-psjz6") pod "a04bc0f1-a395-4302-9192-e96b0fc06041" (UID: "a04bc0f1-a395-4302-9192-e96b0fc06041"). InnerVolumeSpecName "kube-api-access-psjz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:30:03.699612 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:03.699489 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjz6\" (UniqueName: \"kubernetes.io/projected/a04bc0f1-a395-4302-9192-e96b0fc06041-kube-api-access-psjz6\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:30:04.407200 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:04.407169 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" event={"ID":"a04bc0f1-a395-4302-9192-e96b0fc06041","Type":"ContainerDied","Data":"261cf188ad25d0bda6bf587e4cfdbdfb90cb188c56774e870e5a5f16881e0f75"} Jul 02 17:30:04.407200 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:04.407198 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-5vmvv" Jul 02 17:30:04.407378 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:04.407215 2535 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="261cf188ad25d0bda6bf587e4cfdbdfb90cb188c56774e870e5a5f16881e0f75" Jul 02 17:30:09.340180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:09.340141 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:09.445297 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:09.445261 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:09.540146 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:09.540106 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:20.108124 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:20.108086 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:20.470186 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:20.470150 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:41.448328 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:41.448270 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:47.118924 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.118882 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:47.196196 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.196152 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:47.500834 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.500797 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:47.733734 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.733701 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd"] Jul 02 17:30:47.734187 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.734166 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" Jul 02 17:30:47.734187 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.734188 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" Jul 02 17:30:47.734334 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.734199 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a04bc0f1-a395-4302-9192-e96b0fc06041" containerName="cleanup" Jul 02 17:30:47.734334 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.734205 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="a04bc0f1-a395-4302-9192-e96b0fc06041" containerName="cleanup" Jul 02 17:30:47.734334 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.734272 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="94310390-5c35-4bb3-98a5-95a6b4e6d8ea" containerName="istio-proxy" Jul 02 17:30:47.734334 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.734290 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="a04bc0f1-a395-4302-9192-e96b0fc06041" containerName="cleanup" Jul 02 17:30:47.737365 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.737349 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.739590 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.739571 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8a6030-openshift-default-dockercfg-wpzc4\"" Jul 02 17:30:47.748130 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.748109 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd"] Jul 02 17:30:47.761707 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.761616 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:47.870891 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.870859 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-token\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.870891 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.870894 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkch\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-kube-api-access-dfkch\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.870922 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-certs\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.870971 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-socket\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.871007 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-podinfo\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.871070 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-envoy\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871103 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.871100 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b654d7-c08c-47d7-9c58-339529b3534a-istiod-ca-cert\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871262 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.871119 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-data\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.871262 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.871174 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-credential-socket\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972171 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972134 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-credential-socket\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972185 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-token\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972206 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkch\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-kube-api-access-dfkch\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972234 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-certs\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972251 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-socket\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972279 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-podinfo\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972323 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-envoy\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972369 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972347 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b654d7-c08c-47d7-9c58-339529b3534a-istiod-ca-cert\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972749 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972374 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-data\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972794 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972742 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-certs\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972794 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972771 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-socket\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972914 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972808 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-data\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.972997 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.972974 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-credential-socket\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.973333 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.973311 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b654d7-c08c-47d7-9c58-339529b3534a-istiod-ca-cert\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.974775 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.974754 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-envoy\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.974892 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.974871 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-podinfo\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.980074 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.980046 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-token\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:47.980285 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:47.980264 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkch\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-kube-api-access-dfkch\") pod \"e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:48.048214 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.048147 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:48.193939 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.193894 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd"] Jul 02 17:30:48.194379 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:30:48.194350 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b654d7_c08c_47d7_9c58_339529b3534a.slice/crio-3c7efcb1ef36336ca6654bf76cb15aea76ddbb07a87d1b3203a48d33d40d9e01 WatchSource:0}: Error finding container 3c7efcb1ef36336ca6654bf76cb15aea76ddbb07a87d1b3203a48d33d40d9e01: Status 404 returned error can't find the container with id 3c7efcb1ef36336ca6654bf76cb15aea76ddbb07a87d1b3203a48d33d40d9e01 Jul 02 17:30:48.197117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.197076 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:48.197212 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.197162 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:48.197252 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.197238 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:48.293898 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.293863 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:48.629087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.629050 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" event={"ID":"b2b654d7-c08c-47d7-9c58-339529b3534a","Type":"ContainerStarted","Data":"dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3"} Jul 02 17:30:48.629298 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.629107 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" event={"ID":"b2b654d7-c08c-47d7-9c58-339529b3534a","Type":"ContainerStarted","Data":"3c7efcb1ef36336ca6654bf76cb15aea76ddbb07a87d1b3203a48d33d40d9e01"} Jul 02 17:30:48.648595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:48.648528 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podStartSLOduration=1.6485144699999998 podStartE2EDuration="1.64851447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:30:48.647175925 +0000 UTC m=+2026.751194468" watchObservedRunningTime="2026-07-02 17:30:48.64851447 +0000 UTC m=+2026.752533013" Jul 02 17:30:49.048908 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:49.048880 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:49.053604 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:49.053578 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:49.634026 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:49.633999 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:49.634966 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:49.634941 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:30:50.691296 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:50.691260 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:50.794847 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:50.794809 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:50.870757 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:50.870725 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:51.014340 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:51.014307 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:51.453638 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:51.453596 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:51.554866 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:51.554829 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:55.199391 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.199357 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:55.545307 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.545267 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:55.827113 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.827035 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk"] Jul 02 17:30:55.830888 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.830870 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.833649 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.833620 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5569c1-openshift-default-dockercfg-gxcz7\"" Jul 02 17:30:55.835958 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.835937 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-socket\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.835968 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-podinfo\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836009 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-data\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836069 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-token\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836117 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b1cbede-2fa9-4934-a64f-93091f7666f8-istiod-ca-cert\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836145 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c9ht\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-kube-api-access-4c9ht\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836197 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-envoy\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836349 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836246 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-credential-socket\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.836349 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.836261 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-certs\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.842102 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.842077 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk"] Jul 02 17:30:55.863421 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.863393 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:55.937759 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.937722 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-envoy\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.937978 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.937848 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-credential-socket\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938055 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.937879 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-certs\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938137 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938118 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-socket\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938185 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938152 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-podinfo\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938283 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938195 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-data\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938283 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938244 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-token\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938283 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938275 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b1cbede-2fa9-4934-a64f-93091f7666f8-istiod-ca-cert\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938477 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938298 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9ht\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-kube-api-access-4c9ht\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938669 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938643 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-certs\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.938935 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938917 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-data\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.939023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.938961 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-socket\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.939190 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.939170 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-credential-socket\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.939579 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.939557 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b1cbede-2fa9-4934-a64f-93091f7666f8-istiod-ca-cert\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.940728 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.940695 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-envoy\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.941433 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.941412 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-podinfo\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.947344 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.947321 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-token\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:55.947613 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:55.947596 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c9ht\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-kube-api-access-4c9ht\") pod \"e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:56.072318 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.072282 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:56.143244 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.143159 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:56.290988 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.290961 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk"] Jul 02 17:30:56.291577 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:30:56.291527 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1cbede_2fa9_4934_a64f_93091f7666f8.slice/crio-608ee2cb67b4d29b363f01baeefe2a21e2fb53a84c7634d70c8ef939f415b900 WatchSource:0}: Error finding container 608ee2cb67b4d29b363f01baeefe2a21e2fb53a84c7634d70c8ef939f415b900: Status 404 returned error can't find the container with id 608ee2cb67b4d29b363f01baeefe2a21e2fb53a84c7634d70c8ef939f415b900 Jul 02 17:30:56.293639 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.293607 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:56.293750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.293682 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:56.293750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.293726 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:30:56.671219 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.671179 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" event={"ID":"2b1cbede-2fa9-4934-a64f-93091f7666f8","Type":"ContainerStarted","Data":"4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9"} Jul 02 17:30:56.671392 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.671230 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" event={"ID":"2b1cbede-2fa9-4934-a64f-93091f7666f8","Type":"ContainerStarted","Data":"608ee2cb67b4d29b363f01baeefe2a21e2fb53a84c7634d70c8ef939f415b900"} Jul 02 17:30:56.692380 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:56.692330 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" podStartSLOduration=1.692314685 podStartE2EDuration="1.692314685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:30:56.690683078 +0000 UTC m=+2034.794701621" watchObservedRunningTime="2026-07-02 17:30:56.692314685 +0000 UTC m=+2034.796333226" Jul 02 17:30:57.143736 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:57.143705 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:57.148368 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:57.148345 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:57.676331 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:57.676297 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:57.677311 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:57.677290 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:30:58.680448 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:58.680411 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:58.771200 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:58.771164 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:58.849479 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:58.849438 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:59.124706 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:59.124670 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:59.253261 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:59.253219 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:30:59.355625 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:30:59.355586 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:03.187841 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:03.187811 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:04.635972 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.635936 2535 patch_prober.go:28] interesting pod/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 02 17:31:04.638424 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.636453 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 02 17:31:04.718763 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.718729 2535 generic.go:356] "Generic (PLEG): container finished" podID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerID="dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3" exitCode=0 Jul 02 17:31:04.718914 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.718798 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" event={"ID":"b2b654d7-c08c-47d7-9c58-339529b3534a","Type":"ContainerDied","Data":"dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3"} Jul 02 17:31:04.719173 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.719158 2535 scope.go:117] "RemoveContainer" containerID="dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3" Jul 02 17:31:04.720192 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.720164 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:31:04.720293 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.720244 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:31:04.720355 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:04.720289 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:31:05.727356 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:05.727314 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" event={"ID":"b2b654d7-c08c-47d7-9c58-339529b3534a","Type":"ContainerStarted","Data":"da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0"} Jul 02 17:31:06.049377 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:06.049277 2535 patch_prober.go:28] interesting pod/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 02 17:31:06.049709 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:06.049683 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 02 17:31:06.050119 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:06.049619 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:31:07.049117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:07.049077 2535 patch_prober.go:28] interesting pod/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 02 17:31:07.049511 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:07.049147 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 02 17:31:08.048810 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:08.048771 2535 patch_prober.go:28] interesting pod/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 02 17:31:08.049036 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:08.048844 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 02 17:31:09.049066 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:09.049023 2535 patch_prober.go:28] interesting pod/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 02 17:31:09.049465 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:09.049094 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 02 17:31:10.053006 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.052925 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:31:10.053468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.053393 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:31:10.054143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.054124 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:31:10.763249 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.763214 2535 generic.go:356] "Generic (PLEG): container finished" podID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerID="4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9" exitCode=0 Jul 02 17:31:10.763427 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.763291 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" event={"ID":"2b1cbede-2fa9-4934-a64f-93091f7666f8","Type":"ContainerDied","Data":"4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9"} Jul 02 17:31:10.763802 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.763776 2535 scope.go:117] "RemoveContainer" containerID="4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9" Jul 02 17:31:10.764724 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.764687 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:31:10.764810 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.764763 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:31:10.764810 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:10.764801 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:31:11.771117 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:11.771085 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" event={"ID":"2b1cbede-2fa9-4934-a64f-93091f7666f8","Type":"ContainerStarted","Data":"fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d"} Jul 02 17:31:12.144252 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:12.144149 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:31:12.145956 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:12.145613 2535 patch_prober.go:28] interesting pod/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 02 17:31:12.145956 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:12.145680 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 02 17:31:12.676798 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:12.676760 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:31:13.143854 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:13.143814 2535 patch_prober.go:28] interesting pod/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 02 17:31:13.144358 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:13.143880 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 02 17:31:13.215061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:13.215030 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:13.318307 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:13.318272 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:14.143778 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:14.143742 2535 patch_prober.go:28] interesting pod/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 02 17:31:14.144061 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:14.144033 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 02 17:31:15.144159 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:15.144121 2535 patch_prober.go:28] interesting pod/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 02 17:31:15.144778 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:15.144743 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 02 17:31:16.147348 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:16.147320 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:31:16.148832 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:16.148805 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:31:19.480944 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:19.480911 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:20.390557 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:20.390509 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:20.491667 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:20.491618 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:31:57.328525 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:31:57.328482 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:02.484653 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:02.484626 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:32:02.491670 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:02.491648 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:32:02.492230 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:02.492209 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:32:02.498583 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:02.498566 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:32:05.136023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:05.135987 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:17.150389 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:17.150352 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:18.115940 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:18.115907 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:18.295766 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:18.295732 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:18.661911 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:18.661869 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:18.795921 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:18.795880 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:18.897218 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:18.897183 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:19.041759 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:19.041724 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:32:23.747123 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:32:23.747084 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:00.449583 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:00.449464 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:00.761860 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:00.761824 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd"] Jul 02 17:33:00.762044 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:00.762022 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" containerID="cri-o://da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0" gracePeriod=30 Jul 02 17:33:00.778841 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:00.778776 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:01.029503 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:01.029411 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:01.435837 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:01.435748 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:01.827734 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:01.827700 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:01.929251 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:01.929216 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:02.033585 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:02.033551 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:02.128462 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:02.128365 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:06.016806 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.016785 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:33:06.199656 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199566 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-podinfo\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199656 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199623 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkch\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-kube-api-access-dfkch\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199656 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199651 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-credential-socket\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199695 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-socket\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199761 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b654d7-c08c-47d7-9c58-339529b3534a-istiod-ca-cert\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199805 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-data\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199847 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-token\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199876 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-certs\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.199938 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199900 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-envoy\") pod \"b2b654d7-c08c-47d7-9c58-339529b3534a\" (UID: \"b2b654d7-c08c-47d7-9c58-339529b3534a\") " Jul 02 17:33:06.200278 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199943 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:06.200278 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.199955 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:06.200278 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.200221 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.200278 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.200241 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.200278 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.200254 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:06.200586 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.200289 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b654d7-c08c-47d7-9c58-339529b3534a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:06.201249 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.201220 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:06.201914 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.201889 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:33:06.202105 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.202083 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:06.202158 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.202124 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:06.202158 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.202129 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-kube-api-access-dfkch" (OuterVolumeSpecName: "kube-api-access-dfkch") pod "b2b654d7-c08c-47d7-9c58-339529b3534a" (UID: "b2b654d7-c08c-47d7-9c58-339529b3534a"). InnerVolumeSpecName "kube-api-access-dfkch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:06.301468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301431 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b654d7-c08c-47d7-9c58-339529b3534a-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.301468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301462 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.301468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301470 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.301468 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301478 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.301757 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301487 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.301757 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301496 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b654d7-c08c-47d7-9c58-339529b3534a-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.301757 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.301505 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkch\" (UniqueName: \"kubernetes.io/projected/b2b654d7-c08c-47d7-9c58-339529b3534a-kube-api-access-dfkch\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:06.392244 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.392212 2535 generic.go:356] "Generic (PLEG): container finished" podID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerID="da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0" exitCode=0 Jul 02 17:33:06.392406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.392296 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" Jul 02 17:33:06.392406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.392300 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" event={"ID":"b2b654d7-c08c-47d7-9c58-339529b3534a","Type":"ContainerDied","Data":"da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0"} Jul 02 17:33:06.392406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.392350 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd" event={"ID":"b2b654d7-c08c-47d7-9c58-339529b3534a","Type":"ContainerDied","Data":"3c7efcb1ef36336ca6654bf76cb15aea76ddbb07a87d1b3203a48d33d40d9e01"} Jul 02 17:33:06.392406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.392372 2535 scope.go:117] "RemoveContainer" containerID="da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0" Jul 02 17:33:06.401743 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.401608 2535 scope.go:117] "RemoveContainer" containerID="dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3" Jul 02 17:33:06.409899 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.409883 2535 scope.go:117] "RemoveContainer" containerID="da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0" Jul 02 17:33:06.410130 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:06.410111 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0\": container with ID starting with da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0 not found: ID does not exist" containerID="da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0" Jul 02 17:33:06.410169 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.410139 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0"} err="failed to get container status \"da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0\": rpc error: code = NotFound desc = could not find container \"da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0\": container with ID starting with da36d8930dbcd9a3c61c7b47f75a7ab7c93ab1234928c1db78f3ed836f9d96d0 not found: ID does not exist" Jul 02 17:33:06.410169 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.410158 2535 scope.go:117] "RemoveContainer" containerID="dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3" Jul 02 17:33:06.410390 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:06.410374 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3\": container with ID starting with dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3 not found: ID does not exist" containerID="dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3" Jul 02 17:33:06.410427 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.410397 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3"} err="failed to get container status \"dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3\": rpc error: code = NotFound desc = could not find container \"dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3\": container with ID starting with dd57af8887ebcf7eb769658290746fbe392173f9d53ae96f94aafa1414fc6cf3 not found: ID does not exist" Jul 02 17:33:06.419108 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.419087 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd"] Jul 02 17:33:06.422574 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:06.422552 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8a6030-openshift-default-6f97f56945-ckngd"] Jul 02 17:33:07.473997 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:07.473963 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:07.576430 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:07.576398 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:07.742983 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:07.742889 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk"] Jul 02 17:33:07.743164 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:07.743140 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" containerID="cri-o://fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d" gracePeriod=30 Jul 02 17:33:07.768759 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:07.768733 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:08.006098 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.006016 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:08.340885 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.340787 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:08.389714 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.389673 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" path="/var/lib/kubelet/pods/b2b654d7-c08c-47d7-9c58-339529b3534a/volumes" Jul 02 17:33:08.659213 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.659135 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th"] Jul 02 17:33:08.659582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.659445 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" Jul 02 17:33:08.659582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.659455 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" Jul 02 17:33:08.659582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.659522 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" Jul 02 17:33:08.659582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.659529 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" Jul 02 17:33:08.662372 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.662353 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.664967 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.664949 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f10fdf-openshift-default-dockercfg-xtvf8\"" Jul 02 17:33:08.681755 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.681730 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th"] Jul 02 17:33:08.694697 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.694674 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:08.822365 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822333 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92df38f8-6600-42b1-a17c-70ce1a88693f-istiod-ca-cert\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822365 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822368 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-certs\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822617 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822391 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-token\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822617 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822496 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-envoy\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822617 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822565 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-data\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822617 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822600 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-credential-socket\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822802 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822644 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-socket\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822802 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822699 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-podinfo\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.822802 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.822773 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d486k\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-kube-api-access-d486k\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923368 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-envoy\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923407 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-data\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923452 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923428 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-credential-socket\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923464 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-socket\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923518 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-podinfo\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923569 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d486k\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-kube-api-access-d486k\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923609 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92df38f8-6600-42b1-a17c-70ce1a88693f-istiod-ca-cert\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923632 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-certs\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.923722 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923663 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-token\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.924042 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923899 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-credential-socket\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.924042 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.923935 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-socket\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.924165 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.924078 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-certs\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.924165 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.924129 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-data\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.924309 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.924288 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92df38f8-6600-42b1-a17c-70ce1a88693f-istiod-ca-cert\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.925675 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.925651 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-envoy\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.926136 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.926116 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-podinfo\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.937474 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.937449 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-token\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.937696 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.937674 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d486k\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-kube-api-access-d486k\") pod \"e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:08.972820 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:08.972796 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:09.014873 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.014842 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:09.113611 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.113579 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th"] Jul 02 17:33:09.114990 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:33:09.114966 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92df38f8_6600_42b1_a17c_70ce1a88693f.slice/crio-7af7b2db2d2441fb692d39af92ab6bd18d726c64f904d064b3c31121653270ed WatchSource:0}: Error finding container 7af7b2db2d2441fb692d39af92ab6bd18d726c64f904d064b3c31121653270ed: Status 404 returned error can't find the container with id 7af7b2db2d2441fb692d39af92ab6bd18d726c64f904d064b3c31121653270ed Jul 02 17:33:09.117021 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.116987 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:09.117099 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.117050 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:09.117099 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.117076 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:09.411463 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.411425 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" event={"ID":"92df38f8-6600-42b1-a17c-70ce1a88693f","Type":"ContainerStarted","Data":"d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3"} Jul 02 17:33:09.411682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.411493 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" event={"ID":"92df38f8-6600-42b1-a17c-70ce1a88693f","Type":"ContainerStarted","Data":"7af7b2db2d2441fb692d39af92ab6bd18d726c64f904d064b3c31121653270ed"} Jul 02 17:33:09.439510 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.439450 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podStartSLOduration=1.439427837 podStartE2EDuration="1.439427837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:09.435505894 +0000 UTC m=+2167.539524433" watchObservedRunningTime="2026-07-02 17:33:09.439427837 +0000 UTC m=+2167.543446382" Jul 02 17:33:09.973108 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:09.973062 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:10.978299 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:10.978269 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:11.423261 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:11.423175 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:11.424436 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:11.424411 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:11.479387 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:11.479353 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:11.575196 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:11.575133 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:11.635518 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:11.635479 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:11.793632 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:11.793600 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:12.238591 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:12.238533 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:12.336176 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:12.336134 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:12.998727 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:12.998705 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:33:13.160475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160381 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b1cbede-2fa9-4934-a64f-93091f7666f8-istiod-ca-cert\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160429 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c9ht\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-kube-api-access-4c9ht\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160473 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-podinfo\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160505 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-socket\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160530 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-data\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160598 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-certs\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160649 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-credential-socket\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160717 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-token\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.160774 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160751 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-envoy\") pod \"2b1cbede-2fa9-4934-a64f-93091f7666f8\" (UID: \"2b1cbede-2fa9-4934-a64f-93091f7666f8\") " Jul 02 17:33:13.161080 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160970 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:13.161080 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.160976 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b1cbede-2fa9-4934-a64f-93091f7666f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:13.161198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.161076 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:13.161198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.161089 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.161198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.161120 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b1cbede-2fa9-4934-a64f-93091f7666f8-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.161198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.161173 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:13.161470 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.161445 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:13.162978 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.162948 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:13.163064 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.162997 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:13.163155 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.163137 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:33:13.163264 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.163181 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-kube-api-access-4c9ht" (OuterVolumeSpecName: "kube-api-access-4c9ht") pod "2b1cbede-2fa9-4934-a64f-93091f7666f8" (UID: "2b1cbede-2fa9-4934-a64f-93091f7666f8"). InnerVolumeSpecName "kube-api-access-4c9ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:13.261669 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261635 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.261669 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261661 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.261669 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261671 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.261669 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261679 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.262134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261687 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.262134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261696 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b1cbede-2fa9-4934-a64f-93091f7666f8-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.262134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.261704 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c9ht\" (UniqueName: \"kubernetes.io/projected/2b1cbede-2fa9-4934-a64f-93091f7666f8-kube-api-access-4c9ht\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:13.435301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.435217 2535 generic.go:356] "Generic (PLEG): container finished" podID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerID="fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d" exitCode=0 Jul 02 17:33:13.435301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.435256 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" Jul 02 17:33:13.435301 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.435293 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" event={"ID":"2b1cbede-2fa9-4934-a64f-93091f7666f8","Type":"ContainerDied","Data":"fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d"} Jul 02 17:33:13.435519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.435347 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk" event={"ID":"2b1cbede-2fa9-4934-a64f-93091f7666f8","Type":"ContainerDied","Data":"608ee2cb67b4d29b363f01baeefe2a21e2fb53a84c7634d70c8ef939f415b900"} Jul 02 17:33:13.435519 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.435371 2535 scope.go:117] "RemoveContainer" containerID="fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d" Jul 02 17:33:13.445167 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.445149 2535 scope.go:117] "RemoveContainer" containerID="4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9" Jul 02 17:33:13.453580 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.453563 2535 scope.go:117] "RemoveContainer" containerID="fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d" Jul 02 17:33:13.453826 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:13.453804 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d\": container with ID starting with fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d not found: ID does not exist" containerID="fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d" Jul 02 17:33:13.453878 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.453835 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d"} err="failed to get container status \"fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d\": rpc error: code = NotFound desc = could not find container \"fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d\": container with ID starting with fdfe562d8fad1e35956c7bb073dc5670842a7c7e975f1fba0e7e57027bfa683d not found: ID does not exist" Jul 02 17:33:13.453878 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.453853 2535 scope.go:117] "RemoveContainer" containerID="4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9" Jul 02 17:33:13.454094 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:13.454077 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9\": container with ID starting with 4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9 not found: ID does not exist" containerID="4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9" Jul 02 17:33:13.454142 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.454100 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9"} err="failed to get container status \"4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9\": rpc error: code = NotFound desc = could not find container \"4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9\": container with ID starting with 4e159b5df7e6b4bda37ccfb35ff41c829db1abf00ddfcbbecab17fb75bbdf1e9 not found: ID does not exist" Jul 02 17:33:13.457187 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.457166 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk"] Jul 02 17:33:13.461323 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:13.461304 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5569c1-openshift-default-7f887b5b69-qbpxk"] Jul 02 17:33:14.389181 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:14.389148 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" path="/var/lib/kubelet/pods/2b1cbede-2fa9-4934-a64f-93091f7666f8/volumes" Jul 02 17:33:15.988074 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:15.988034 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:16.318767 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.318671 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:16.417971 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.417933 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:16.518560 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.518506 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:16.723297 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723266 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd"] Jul 02 17:33:16.723683 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723665 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" Jul 02 17:33:16.723782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723685 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" Jul 02 17:33:16.723782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723704 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" Jul 02 17:33:16.723782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723711 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" Jul 02 17:33:16.723782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723740 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" Jul 02 17:33:16.723782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723749 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b654d7-c08c-47d7-9c58-339529b3534a" containerName="istio-proxy" Jul 02 17:33:16.724087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723835 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" Jul 02 17:33:16.724087 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.723852 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b1cbede-2fa9-4934-a64f-93091f7666f8" containerName="istio-proxy" Jul 02 17:33:16.728261 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.728240 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.730449 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.730429 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9cdf01-openshift-default-dockercfg-9w62j\"" Jul 02 17:33:16.738724 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.738698 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd"] Jul 02 17:33:16.751925 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.751892 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:16.893595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893562 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93194452-c6a7-4237-b2a8-4c54aabf7cba-istiod-ca-cert\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893621 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-certs\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893647 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-socket\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893661 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-credential-socket\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893695 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-data\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893718 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-envoy\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893745 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-podinfo\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.893780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893762 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-token\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.894015 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.893804 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbl5j\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-kube-api-access-kbl5j\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.904811 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.904782 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:16.994960 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.994873 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93194452-c6a7-4237-b2a8-4c54aabf7cba-istiod-ca-cert\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.994960 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.994927 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-certs\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.994960 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.994958 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-socket\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.994973 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-credential-socket\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995001 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-data\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995023 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-envoy\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995061 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-podinfo\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995082 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-token\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995106 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbl5j\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-kube-api-access-kbl5j\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995390 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-socket\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995587 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-data\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995624 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-certs\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995717 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93194452-c6a7-4237-b2a8-4c54aabf7cba-istiod-ca-cert\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.995896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.995775 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-credential-socket\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.997454 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.997429 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-envoy\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:16.997611 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:16.997593 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-podinfo\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:17.002440 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.002412 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-token\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:17.002633 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.002616 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbl5j\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-kube-api-access-kbl5j\") pod \"e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:17.039447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.039425 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:17.216599 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.216572 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd"] Jul 02 17:33:17.217478 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:33:17.217449 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93194452_c6a7_4237_b2a8_4c54aabf7cba.slice/crio-f1eedb3226811e52ff047c54f1150c16e06ce18a5569cb693da17b111bfd8d08 WatchSource:0}: Error finding container f1eedb3226811e52ff047c54f1150c16e06ce18a5569cb693da17b111bfd8d08: Status 404 returned error can't find the container with id f1eedb3226811e52ff047c54f1150c16e06ce18a5569cb693da17b111bfd8d08 Jul 02 17:33:17.219692 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.219662 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:17.219775 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.219721 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:17.219775 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.219747 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:17.459816 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.459775 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" event={"ID":"93194452-c6a7-4237-b2a8-4c54aabf7cba","Type":"ContainerStarted","Data":"1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8"} Jul 02 17:33:17.460007 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.459837 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" event={"ID":"93194452-c6a7-4237-b2a8-4c54aabf7cba","Type":"ContainerStarted","Data":"f1eedb3226811e52ff047c54f1150c16e06ce18a5569cb693da17b111bfd8d08"} Jul 02 17:33:17.480761 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:17.480711 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podStartSLOduration=1.480696652 podStartE2EDuration="1.480696652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:17.478113289 +0000 UTC m=+2175.582131832" watchObservedRunningTime="2026-07-02 17:33:17.480696652 +0000 UTC m=+2175.584715265" Jul 02 17:33:18.040433 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:18.040400 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:18.045308 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:18.045282 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:18.464875 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:18.464833 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:18.465661 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:18.465641 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:19.497705 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:19.497670 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:19.583892 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:19.583860 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:19.646366 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:19.646337 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:20.181374 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:20.181340 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:20.281641 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:20.281606 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:24.052845 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:24.052783 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:27.464782 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:27.464737 2535 patch_prober.go:28] interesting pod/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 17:33:27.465179 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:27.464809 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 17:33:28.518327 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:28.518282 2535 generic.go:356] "Generic (PLEG): container finished" podID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerID="d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3" exitCode=0 Jul 02 17:33:28.518771 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:28.518354 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" event={"ID":"92df38f8-6600-42b1-a17c-70ce1a88693f","Type":"ContainerDied","Data":"d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3"} Jul 02 17:33:28.518771 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:28.518721 2535 scope.go:117] "RemoveContainer" containerID="d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3" Jul 02 17:33:28.519739 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:28.519711 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:28.519814 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:28.519796 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:28.519855 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:28.519845 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:29.527239 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:29.527198 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" event={"ID":"92df38f8-6600-42b1-a17c-70ce1a88693f","Type":"ContainerStarted","Data":"fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081"} Jul 02 17:33:29.974268 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:29.974225 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:29.974454 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:29.974359 2535 patch_prober.go:28] interesting pod/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 02 17:33:29.974454 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:29.974405 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 02 17:33:30.974022 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:30.973983 2535 patch_prober.go:28] interesting pod/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 02 17:33:30.974426 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:30.974052 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 02 17:33:31.974193 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:31.974148 2535 patch_prober.go:28] interesting pod/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 02 17:33:31.974692 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:31.974233 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 02 17:33:32.159134 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:32.159059 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:32.602095 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:32.602061 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:32.843097 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:32.843057 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:32.945475 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:32.945364 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:32.973129 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:32.973089 2535 patch_prober.go:28] interesting pod/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 02 17:33:32.973331 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:32.973152 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 02 17:33:33.106032 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:33.106002 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:33.977959 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:33.977930 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:33.978224 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:33.978202 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:33.978995 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:33.978973 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:34.506742 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:34.506701 2535 patch_prober.go:28] interesting pod/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 17:33:34.507145 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:34.506774 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 17:33:36.574306 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:36.574272 2535 generic.go:356] "Generic (PLEG): container finished" podID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerID="1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8" exitCode=0 Jul 02 17:33:36.574754 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:36.574345 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" event={"ID":"93194452-c6a7-4237-b2a8-4c54aabf7cba","Type":"ContainerDied","Data":"1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8"} Jul 02 17:33:36.574754 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:36.574725 2535 scope.go:117] "RemoveContainer" containerID="1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8" Jul 02 17:33:36.575731 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:36.575670 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:36.575824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:36.575805 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:36.575871 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:36.575857 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:37.581097 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:37.581067 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" event={"ID":"93194452-c6a7-4237-b2a8-4c54aabf7cba","Type":"ContainerStarted","Data":"169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a"} Jul 02 17:33:38.040306 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.040258 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:38.040655 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.040627 2535 patch_prober.go:28] interesting pod/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 02 17:33:38.040768 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.040690 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 02 17:33:38.476194 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.476161 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:38.534249 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.534210 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:38.758566 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.758451 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th"] Jul 02 17:33:38.759308 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.759275 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" containerID="cri-o://fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081" gracePeriod=30 Jul 02 17:33:38.772085 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.772035 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:38.993228 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:38.993186 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:39.040831 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:39.040747 2535 patch_prober.go:28] interesting pod/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 02 17:33:39.040831 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:39.040818 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 02 17:33:39.182834 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:39.182799 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:39.586088 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:39.586051 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:39.688390 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:39.688358 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:39.830417 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:39.830376 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:40.040181 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:40.040146 2535 patch_prober.go:28] interesting pod/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 02 17:33:40.040473 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:40.040446 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 02 17:33:41.040504 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:41.040453 2535 patch_prober.go:28] interesting pod/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 02 17:33:41.041037 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:41.040566 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 02 17:33:42.043341 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:42.043311 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:42.043825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:42.043718 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:42.044279 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:42.044258 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:44.015830 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.015800 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:44.141422 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141343 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92df38f8-6600-42b1-a17c-70ce1a88693f-istiod-ca-cert\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141422 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141395 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-credential-socket\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141642 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141508 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d486k\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-kube-api-access-d486k\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141642 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141578 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-envoy\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141642 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141617 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-socket\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141798 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141663 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-token\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141798 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141690 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-certs\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141798 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141725 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-podinfo\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.141798 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141779 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-data\") pod \"92df38f8-6600-42b1-a17c-70ce1a88693f\" (UID: \"92df38f8-6600-42b1-a17c-70ce1a88693f\") " Jul 02 17:33:44.142009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141690 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:44.142009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141732 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92df38f8-6600-42b1-a17c-70ce1a88693f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:44.142009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141883 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:44.142009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.141933 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:44.142180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.142090 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92df38f8-6600-42b1-a17c-70ce1a88693f-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.142180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.142109 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.142180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.142122 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.142180 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.142136 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.142691 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.142661 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-data" (OuterVolumeSpecName: "istio-data") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:44.143760 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.143736 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-kube-api-access-d486k" (OuterVolumeSpecName: "kube-api-access-d486k") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "kube-api-access-d486k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:44.143846 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.143767 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-token" (OuterVolumeSpecName: "istio-token") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:44.143846 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.143774 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:44.143846 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.143816 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92df38f8-6600-42b1-a17c-70ce1a88693f" (UID: "92df38f8-6600-42b1-a17c-70ce1a88693f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:33:44.243397 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.243364 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.243397 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.243391 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.243397 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.243400 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.243651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.243409 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d486k\" (UniqueName: \"kubernetes.io/projected/92df38f8-6600-42b1-a17c-70ce1a88693f-kube-api-access-d486k\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.243651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.243418 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92df38f8-6600-42b1-a17c-70ce1a88693f-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:44.620903 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.620868 2535 generic.go:356] "Generic (PLEG): container finished" podID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerID="fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081" exitCode=0 Jul 02 17:33:44.621045 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.620927 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" Jul 02 17:33:44.621045 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.620954 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" event={"ID":"92df38f8-6600-42b1-a17c-70ce1a88693f","Type":"ContainerDied","Data":"fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081"} Jul 02 17:33:44.621045 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.621011 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th" event={"ID":"92df38f8-6600-42b1-a17c-70ce1a88693f","Type":"ContainerDied","Data":"7af7b2db2d2441fb692d39af92ab6bd18d726c64f904d064b3c31121653270ed"} Jul 02 17:33:44.621045 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.621036 2535 scope.go:117] "RemoveContainer" containerID="fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081" Jul 02 17:33:44.630517 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.630500 2535 scope.go:117] "RemoveContainer" containerID="d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3" Jul 02 17:33:44.637963 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.637940 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th"] Jul 02 17:33:44.638870 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.638851 2535 scope.go:117] "RemoveContainer" containerID="fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081" Jul 02 17:33:44.645073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.645050 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f10fdf-openshift-default-78f5f784b5-z49th"] Jul 02 17:33:44.645378 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:44.645355 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081\": container with ID starting with fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081 not found: ID does not exist" containerID="fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081" Jul 02 17:33:44.645587 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.645529 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081"} err="failed to get container status \"fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081\": rpc error: code = NotFound desc = could not find container \"fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081\": container with ID starting with fffd7d7560155f4a0a4b35c60d0b2d7f6d159baf8c2f7d20917cc5124ea1e081 not found: ID does not exist" Jul 02 17:33:44.645710 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.645698 2535 scope.go:117] "RemoveContainer" containerID="d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3" Jul 02 17:33:44.646822 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:44.646771 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3\": container with ID starting with d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3 not found: ID does not exist" containerID="d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3" Jul 02 17:33:44.646822 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:44.646797 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3"} err="failed to get container status \"d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3\": rpc error: code = NotFound desc = could not find container \"d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3\": container with ID starting with d946ae11e75d4d972d08b644eea3aff774c3bf80c9fc9d30a7dd64346fe023e3 not found: ID does not exist" Jul 02 17:33:45.371936 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:45.371898 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:45.432389 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:45.432351 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:45.608824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:45.608791 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd"] Jul 02 17:33:45.609065 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:45.609039 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" containerID="cri-o://169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a" gracePeriod=30 Jul 02 17:33:45.647910 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:45.647831 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:45.851913 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:45.851880 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:46.197601 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.197567 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:46.389521 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.389487 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" path="/var/lib/kubelet/pods/92df38f8-6600-42b1-a17c-70ce1a88693f/volumes" Jul 02 17:33:46.496659 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.496629 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s"] Jul 02 17:33:46.497027 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.497011 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" Jul 02 17:33:46.497027 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.497028 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" Jul 02 17:33:46.497120 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.497044 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" Jul 02 17:33:46.497120 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.497050 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" Jul 02 17:33:46.497120 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.497106 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" Jul 02 17:33:46.497120 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.497114 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="92df38f8-6600-42b1-a17c-70ce1a88693f" containerName="istio-proxy" Jul 02 17:33:46.500053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.500037 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.502121 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.502097 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0e06fb-openshift-default-dockercfg-5tmln\"" Jul 02 17:33:46.510953 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.510931 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s"] Jul 02 17:33:46.521858 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.521830 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:46.564729 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564702 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-credential-socket\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.564864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564748 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-envoy\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.564864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564774 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-data\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.564864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564799 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0347bf5f-fb29-40da-8896-cb65b5981524-istio-podinfo\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.564864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564841 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-istio-token\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.565018 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564925 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-certs\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.565018 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.564965 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbh8\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-kube-api-access-qpbh8\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.565081 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.565019 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-socket\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.565081 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.565034 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0347bf5f-fb29-40da-8896-cb65b5981524-istiod-ca-cert\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666373 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666330 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbh8\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-kube-api-access-qpbh8\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666400 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-socket\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666425 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0347bf5f-fb29-40da-8896-cb65b5981524-istiod-ca-cert\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666457 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-credential-socket\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666499 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-envoy\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666528 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-data\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666595 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666569 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0347bf5f-fb29-40da-8896-cb65b5981524-istio-podinfo\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666943 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666610 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-istio-token\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666943 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666663 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-certs\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.666943 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.666878 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-socket\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.667111 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.667085 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-data\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.667170 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.667115 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-credential-socket\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.667170 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.667159 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-certs\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.667432 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.667411 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0347bf5f-fb29-40da-8896-cb65b5981524-istiod-ca-cert\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.668904 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.668881 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-envoy\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.669217 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.669188 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0347bf5f-fb29-40da-8896-cb65b5981524-istio-podinfo\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.673962 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.673933 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-istio-token\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.674213 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.674193 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbh8\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-kube-api-access-qpbh8\") pod \"e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.788996 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.788915 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:46.811825 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.811803 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:46.945628 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.945596 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s"] Jul 02 17:33:46.947031 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:33:46.947002 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0347bf5f_fb29_40da_8896_cb65b5981524.slice/crio-ceeb5632d66b6b8ff44f0025e4e448c6362311baef2e1af6fcc729adcf6d960a WatchSource:0}: Error finding container ceeb5632d66b6b8ff44f0025e4e448c6362311baef2e1af6fcc729adcf6d960a: Status 404 returned error can't find the container with id ceeb5632d66b6b8ff44f0025e4e448c6362311baef2e1af6fcc729adcf6d960a Jul 02 17:33:46.948983 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.948953 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:46.949053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.949019 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:46.949053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:46.949049 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:47.254141 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:47.254107 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:47.641835 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:47.641748 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" event={"ID":"0347bf5f-fb29-40da-8896-cb65b5981524","Type":"ContainerStarted","Data":"09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf"} Jul 02 17:33:47.641835 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:47.641798 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" event={"ID":"0347bf5f-fb29-40da-8896-cb65b5981524","Type":"ContainerStarted","Data":"ceeb5632d66b6b8ff44f0025e4e448c6362311baef2e1af6fcc729adcf6d960a"} Jul 02 17:33:47.662205 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:47.662150 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podStartSLOduration=1.6621335419999999 podStartE2EDuration="1.662133542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:47.660323728 +0000 UTC m=+2205.764342271" watchObservedRunningTime="2026-07-02 17:33:47.662133542 +0000 UTC m=+2205.766152085" Jul 02 17:33:47.812824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:47.812796 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:48.671246 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:48.671203 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:48.817807 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:48.817775 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:49.652023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:49.651993 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:49.653023 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:49.652998 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:33:49.772729 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:49.772694 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:49.856891 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:49.856846 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:49.924053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:49.923969 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:50.429129 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:50.429098 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:50.529771 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:50.529731 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:50.859808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:50.859785 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:51.009560 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009458 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-socket\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009560 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009495 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-data\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009560 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009517 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbl5j\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-kube-api-access-kbl5j\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009579 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-podinfo\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009646 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-credential-socket\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009703 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-certs\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009726 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-token\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009761 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93194452-c6a7-4237-b2a8-4c54aabf7cba-istiod-ca-cert\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.009809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009787 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-envoy\") pod \"93194452-c6a7-4237-b2a8-4c54aabf7cba\" (UID: \"93194452-c6a7-4237-b2a8-4c54aabf7cba\") " Jul 02 17:33:51.010121 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.009993 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:51.010121 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.010006 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:51.010121 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.010104 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:51.010287 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.010120 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.010287 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.010139 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.010385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.010324 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93194452-c6a7-4237-b2a8-4c54aabf7cba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:33:51.010525 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.010495 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-data" (OuterVolumeSpecName: "istio-data") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:51.011934 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.011910 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-token" (OuterVolumeSpecName: "istio-token") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:51.012039 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.011954 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:33:51.012235 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.012219 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:33:51.012302 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.012221 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-kube-api-access-kbl5j" (OuterVolumeSpecName: "kube-api-access-kbl5j") pod "93194452-c6a7-4237-b2a8-4c54aabf7cba" (UID: "93194452-c6a7-4237-b2a8-4c54aabf7cba"). InnerVolumeSpecName "kube-api-access-kbl5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:33:51.110750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110726 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.110750 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110749 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.110896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110758 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbl5j\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-kube-api-access-kbl5j\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.110896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110769 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.110896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110776 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.110896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110784 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93194452-c6a7-4237-b2a8-4c54aabf7cba-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.110896 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.110792 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93194452-c6a7-4237-b2a8-4c54aabf7cba-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:33:51.664821 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.664787 2535 generic.go:356] "Generic (PLEG): container finished" podID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerID="169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a" exitCode=0 Jul 02 17:33:51.664986 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.664845 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" Jul 02 17:33:51.664986 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.664880 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" event={"ID":"93194452-c6a7-4237-b2a8-4c54aabf7cba","Type":"ContainerDied","Data":"169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a"} Jul 02 17:33:51.664986 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.664932 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd" event={"ID":"93194452-c6a7-4237-b2a8-4c54aabf7cba","Type":"ContainerDied","Data":"f1eedb3226811e52ff047c54f1150c16e06ce18a5569cb693da17b111bfd8d08"} Jul 02 17:33:51.664986 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.664956 2535 scope.go:117] "RemoveContainer" containerID="169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a" Jul 02 17:33:51.674267 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.674246 2535 scope.go:117] "RemoveContainer" containerID="1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8" Jul 02 17:33:51.682524 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.682507 2535 scope.go:117] "RemoveContainer" containerID="169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a" Jul 02 17:33:51.682786 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:51.682765 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a\": container with ID starting with 169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a not found: ID does not exist" containerID="169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a" Jul 02 17:33:51.682851 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.682794 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a"} err="failed to get container status \"169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a\": rpc error: code = NotFound desc = could not find container \"169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a\": container with ID starting with 169713c3c477b04ff8f916af941f38928242616cbaa34ca177c5383d88bc483a not found: ID does not exist" Jul 02 17:33:51.682851 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.682812 2535 scope.go:117] "RemoveContainer" containerID="1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8" Jul 02 17:33:51.683064 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:33:51.683047 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8\": container with ID starting with 1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8 not found: ID does not exist" containerID="1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8" Jul 02 17:33:51.683104 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.683072 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8"} err="failed to get container status \"1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8\": rpc error: code = NotFound desc = could not find container \"1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8\": container with ID starting with 1fe956d9f5604fefc0db0d6eed2df99457be47378d9529aa7de39bca68449df8 not found: ID does not exist" Jul 02 17:33:51.686566 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.686530 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd"] Jul 02 17:33:51.691421 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:51.691400 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9cdf01-openshift-default-575db6d56c-n9bsd"] Jul 02 17:33:52.389012 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:52.388976 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" path="/var/lib/kubelet/pods/93194452-c6a7-4237-b2a8-4c54aabf7cba/volumes" Jul 02 17:33:54.266114 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.266073 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:54.589047 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.588955 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:54.867824 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.867733 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml"] Jul 02 17:33:54.868143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.868126 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" Jul 02 17:33:54.868231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.868147 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" Jul 02 17:33:54.868231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.868161 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" Jul 02 17:33:54.868231 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.868169 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" Jul 02 17:33:54.868385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.868275 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" Jul 02 17:33:54.868385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.868288 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="93194452-c6a7-4237-b2a8-4c54aabf7cba" containerName="istio-proxy" Jul 02 17:33:54.871330 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.871306 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:54.874019 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.873998 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d87672-openshift-default-dockercfg-fsbvz\"" Jul 02 17:33:54.884222 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.884192 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml"] Jul 02 17:33:54.897837 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:54.897808 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:55.045864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.045833 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-envoy\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046049 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.045879 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-socket\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046049 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.045975 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-data\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046049 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.046001 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea841ae-988b-476a-82eb-c2487870da3c-istio-podinfo\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046049 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.046022 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea841ae-988b-476a-82eb-c2487870da3c-istiod-ca-cert\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.046112 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-certs\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.046176 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-credential-socket\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.046202 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-istio-token\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.046277 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.046259 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvj4\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-kube-api-access-bsvj4\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147297 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147213 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-envoy\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147297 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147257 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-socket\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147306 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-data\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147329 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea841ae-988b-476a-82eb-c2487870da3c-istio-podinfo\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147350 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea841ae-988b-476a-82eb-c2487870da3c-istiod-ca-cert\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147395 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-certs\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147446 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-credential-socket\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147472 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-istio-token\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147529 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147517 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvj4\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-kube-api-access-bsvj4\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147924 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147774 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-data\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.147924 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.147839 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-socket\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.148086 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.148062 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-certs\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.148152 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.148130 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-credential-socket\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.148208 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.148169 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea841ae-988b-476a-82eb-c2487870da3c-istiod-ca-cert\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.149659 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.149630 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-envoy\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.150123 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.150102 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea841ae-988b-476a-82eb-c2487870da3c-istio-podinfo\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.155417 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.155392 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-istio-token\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.155741 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.155721 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvj4\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-kube-api-access-bsvj4\") pod \"e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.182698 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.182673 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:55.322682 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.322655 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml"] Jul 02 17:33:55.324784 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:33:55.324758 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea841ae_988b_476a_82eb_c2487870da3c.slice/crio-58af0e9534f9423f2b4fdbd8f28468b00fcbf423e924d1ff5bed8ccae1d6e497 WatchSource:0}: Error finding container 58af0e9534f9423f2b4fdbd8f28468b00fcbf423e924d1ff5bed8ccae1d6e497: Status 404 returned error can't find the container with id 58af0e9534f9423f2b4fdbd8f28468b00fcbf423e924d1ff5bed8ccae1d6e497 Jul 02 17:33:55.326978 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.326938 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:55.327069 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.327022 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:55.327110 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.327064 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:33:55.523477 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.523440 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:55.688127 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.688091 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" event={"ID":"1ea841ae-988b-476a-82eb-c2487870da3c","Type":"ContainerStarted","Data":"3939410c92814620331317f5d1133f4bbdf7b22beef7a797f5ed38f9b20440d9"} Jul 02 17:33:55.688281 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.688148 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" event={"ID":"1ea841ae-988b-476a-82eb-c2487870da3c","Type":"ContainerStarted","Data":"58af0e9534f9423f2b4fdbd8f28468b00fcbf423e924d1ff5bed8ccae1d6e497"} Jul 02 17:33:55.707656 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.707628 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:55.708792 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:55.708743 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podStartSLOduration=1.7087274350000001 podStartE2EDuration="1.708727435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:33:55.705725122 +0000 UTC m=+2213.809743677" watchObservedRunningTime="2026-07-02 17:33:55.708727435 +0000 UTC m=+2213.812745979" Jul 02 17:33:56.183505 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:56.183473 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:56.188643 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:56.188616 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:56.693111 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:56.693079 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:56.694179 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:56.694161 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:33:57.700648 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:57.700612 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:57.800388 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:57.800354 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:57.954564 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:57.952994 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:58.170056 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:58.170016 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:58.466967 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:58.466938 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:33:58.572871 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:33:58.572837 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:02.241273 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.241233 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:02.726353 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.726317 2535 generic.go:356] "Generic (PLEG): container finished" podID="0347bf5f-fb29-40da-8896-cb65b5981524" containerID="09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf" exitCode=0 Jul 02 17:34:02.726549 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.726385 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" event={"ID":"0347bf5f-fb29-40da-8896-cb65b5981524","Type":"ContainerDied","Data":"09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf"} Jul 02 17:34:02.726910 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.726894 2535 scope.go:117] "RemoveContainer" containerID="09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf" Jul 02 17:34:02.727966 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.727941 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:34:02.728036 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.728012 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:34:02.728072 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:02.728047 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:34:03.736090 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:03.736043 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" event={"ID":"0347bf5f-fb29-40da-8896-cb65b5981524","Type":"ContainerStarted","Data":"316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6"} Jul 02 17:34:03.812917 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:03.812881 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:34:03.814172 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:03.814146 2535 patch_prober.go:28] interesting pod/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 02 17:34:03.814226 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:03.814201 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 02 17:34:04.652894 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:04.652823 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:34:04.812499 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:04.812461 2535 patch_prober.go:28] interesting pod/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 02 17:34:04.812928 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:04.812527 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 02 17:34:05.812994 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:05.812956 2535 patch_prober.go:28] interesting pod/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 02 17:34:05.813390 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:05.813028 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 02 17:34:06.812642 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:06.812608 2535 patch_prober.go:28] interesting pod/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 02 17:34:06.812837 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:06.812660 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 02 17:34:07.813159 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:07.813121 2535 patch_prober.go:28] interesting pod/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 02 17:34:07.813808 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:07.813183 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 02 17:34:08.816705 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:08.816668 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:34:08.817863 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:08.817842 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:34:11.598294 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.598243 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:11.695020 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.694984 2535 patch_prober.go:28] interesting pod/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 02 17:34:11.695175 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.695052 2535 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 02 17:34:11.698989 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.698959 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:11.794473 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.794438 2535 generic.go:356] "Generic (PLEG): container finished" podID="1ea841ae-988b-476a-82eb-c2487870da3c" containerID="3939410c92814620331317f5d1133f4bbdf7b22beef7a797f5ed38f9b20440d9" exitCode=0 Jul 02 17:34:11.794651 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.794486 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" event={"ID":"1ea841ae-988b-476a-82eb-c2487870da3c","Type":"ContainerDied","Data":"3939410c92814620331317f5d1133f4bbdf7b22beef7a797f5ed38f9b20440d9"} Jul 02 17:34:11.794911 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.794892 2535 scope.go:117] "RemoveContainer" containerID="3939410c92814620331317f5d1133f4bbdf7b22beef7a797f5ed38f9b20440d9" Jul 02 17:34:11.795894 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.795863 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:34:11.795945 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.795933 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:34:11.795982 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:11.795969 2535 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 17:34:12.800840 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:12.800798 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" event={"ID":"1ea841ae-988b-476a-82eb-c2487870da3c","Type":"ContainerStarted","Data":"6f6cced9e875a9e0da0570fd4a671df1f1a23394296a17f4a5039a081107c40a"} Jul 02 17:34:13.183219 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:13.183130 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:34:13.183458 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:13.183433 2535 patch_prober.go:28] interesting pod/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 02 17:34:13.183578 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:13.183490 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 02 17:34:14.183162 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:14.183126 2535 patch_prober.go:28] interesting pod/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 02 17:34:14.183586 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:14.183177 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 02 17:34:15.184035 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:15.183995 2535 patch_prober.go:28] interesting pod/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 02 17:34:15.184425 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:15.184055 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 02 17:34:16.183449 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:16.183413 2535 patch_prober.go:28] interesting pod/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 02 17:34:16.183644 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:16.183482 2535 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 02 17:34:17.187596 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:17.187565 2535 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:34:17.188004 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:17.187954 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:34:17.188866 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:17.188847 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:34:19.324897 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:19.324869 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:19.695403 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:19.695317 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:19.795872 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:19.795841 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:40.226039 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:40.226007 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:34:43.940859 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:34:43.940812 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:35:29.387482 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:35:29.387441 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:36:43.481905 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:36:43.481868 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:36:44.298526 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:36:44.298491 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:36:49.716908 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:36:49.716873 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:37:02.518583 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:02.518528 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:37:02.526040 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:02.526013 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:37:02.527009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:02.526989 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:37:02.533864 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:02.533849 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn8gx_4f8cd8bd-cb03-43bf-8c17-01f69d1bb358/ovn-acl-logging/0.log" Jul 02 17:37:11.990256 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:11.990217 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:37:49.799271 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:49.799239 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:37:50.922141 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:50.922097 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:37:56.725101 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:37:56.725057 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:38:17.045303 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:38:17.045252 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:38:17.148472 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:38:17.148439 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:38:19.728860 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:38:19.728821 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:39:01.907384 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:39:01.907283 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:39:02.614907 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:39:02.614863 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:39:12.824797 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:39:12.824753 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:39:12.922683 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:39:12.922651 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:39:20.837367 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:39:20.837330 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:39:20.934751 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:39:20.934723 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:10.416855 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:10.416818 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:10.798300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:10.798264 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:10.895858 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:10.895824 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:10.997090 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:10.997051 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:11.083803 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:11.083721 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:17.347125 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:17.347071 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:17.447411 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:17.447358 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:17.619094 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:17.619012 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s"] Jul 02 17:40:17.619252 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:17.619227 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" containerID="cri-o://316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6" gracePeriod=30 Jul 02 17:40:17.653630 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:17.653593 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:17.886143 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:17.886057 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:18.094531 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:18.094486 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:18.484199 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:18.484158 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:18.580521 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:18.580487 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:18.690640 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:18.690606 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:18.818249 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:18.818170 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:22.880964 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.880907 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:40:22.948390 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948360 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-certs\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948390 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948392 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpbh8\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-kube-api-access-qpbh8\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948425 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0347bf5f-fb29-40da-8896-cb65b5981524-istio-podinfo\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948457 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-istio-token\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948493 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-socket\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948522 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-data\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948585 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0347bf5f-fb29-40da-8896-cb65b5981524-istiod-ca-cert\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948663 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948631 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-credential-socket\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948995 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948690 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-envoy\") pod \"0347bf5f-fb29-40da-8896-cb65b5981524\" (UID: \"0347bf5f-fb29-40da-8896-cb65b5981524\") " Jul 02 17:40:22.948995 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948725 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:22.948995 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948869 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:22.948995 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948974 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:22.949163 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.948998 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:22.949163 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.949018 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:22.949163 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.949108 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0347bf5f-fb29-40da-8896-cb65b5981524-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:40:22.949817 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.949785 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-data" (OuterVolumeSpecName: "istio-data") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:22.950877 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.950843 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-istio-token" (OuterVolumeSpecName: "istio-token") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:40:22.951003 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.950876 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-kube-api-access-qpbh8" (OuterVolumeSpecName: "kube-api-access-qpbh8") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "kube-api-access-qpbh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:40:22.951003 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.950882 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:22.951003 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:22.950925 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0347bf5f-fb29-40da-8896-cb65b5981524-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0347bf5f-fb29-40da-8896-cb65b5981524" (UID: "0347bf5f-fb29-40da-8896-cb65b5981524"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:40:23.050247 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050212 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.050247 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050243 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpbh8\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-kube-api-access-qpbh8\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.050247 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050253 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0347bf5f-fb29-40da-8896-cb65b5981524-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.050494 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050263 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0347bf5f-fb29-40da-8896-cb65b5981524-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.050494 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050271 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.050494 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050279 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0347bf5f-fb29-40da-8896-cb65b5981524-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.050494 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.050287 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0347bf5f-fb29-40da-8896-cb65b5981524-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:23.711193 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.711161 2535 generic.go:356] "Generic (PLEG): container finished" podID="0347bf5f-fb29-40da-8896-cb65b5981524" containerID="316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6" exitCode=0 Jul 02 17:40:23.711406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.711202 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" event={"ID":"0347bf5f-fb29-40da-8896-cb65b5981524","Type":"ContainerDied","Data":"316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6"} Jul 02 17:40:23.711406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.711208 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" Jul 02 17:40:23.711406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.711244 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s" event={"ID":"0347bf5f-fb29-40da-8896-cb65b5981524","Type":"ContainerDied","Data":"ceeb5632d66b6b8ff44f0025e4e448c6362311baef2e1af6fcc729adcf6d960a"} Jul 02 17:40:23.711406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.711265 2535 scope.go:117] "RemoveContainer" containerID="316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6" Jul 02 17:40:23.721419 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.721399 2535 scope.go:117] "RemoveContainer" containerID="09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf" Jul 02 17:40:23.729818 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.729801 2535 scope.go:117] "RemoveContainer" containerID="316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6" Jul 02 17:40:23.730053 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:40:23.730034 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6\": container with ID starting with 316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6 not found: ID does not exist" containerID="316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6" Jul 02 17:40:23.730100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.730061 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6"} err="failed to get container status \"316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6\": rpc error: code = NotFound desc = could not find container \"316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6\": container with ID starting with 316ca9422733c23abd6168e8f824746a64ef6daad6772df58c6652445a3149a6 not found: ID does not exist" Jul 02 17:40:23.730100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.730080 2535 scope.go:117] "RemoveContainer" containerID="09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf" Jul 02 17:40:23.730350 ip-10-0-128-105 kubenswrapper[2535]: E0702 17:40:23.730334 2535 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf\": container with ID starting with 09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf not found: ID does not exist" containerID="09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf" Jul 02 17:40:23.730408 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.730352 2535 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf"} err="failed to get container status \"09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf\": rpc error: code = NotFound desc = could not find container \"09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf\": container with ID starting with 09d00f64713bfc0f3c6d6a80805e230b5b3bbdc3b20345c3ef8fc0efed0103bf not found: ID does not exist" Jul 02 17:40:23.734142 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.734121 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s"] Jul 02 17:40:23.737674 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:23.737654 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0e06fb-openshift-default-75f4d4fd7-q8d5s"] Jul 02 17:40:24.333185 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.333148 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:24.389214 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.389173 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" path="/var/lib/kubelet/pods/0347bf5f-fb29-40da-8896-cb65b5981524/volumes" Jul 02 17:40:24.432988 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.432956 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:24.581132 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.581100 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml"] Jul 02 17:40:24.581365 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.581341 2535 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" containerID="cri-o://6f6cced9e875a9e0da0570fd4a671df1f1a23394296a17f4a5039a081107c40a" gracePeriod=30 Jul 02 17:40:24.597600 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.597499 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:24.829141 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:24.829090 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:25.271753 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:25.271715 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5769466bd9-h6twg_b8b1760a-221a-41c9-bcd6-a7ec625322ad/authorino/0.log" Jul 02 17:40:29.747792 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.747762 2535 generic.go:356] "Generic (PLEG): container finished" podID="1ea841ae-988b-476a-82eb-c2487870da3c" containerID="6f6cced9e875a9e0da0570fd4a671df1f1a23394296a17f4a5039a081107c40a" exitCode=0 Jul 02 17:40:29.748118 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.747819 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" event={"ID":"1ea841ae-988b-476a-82eb-c2487870da3c","Type":"ContainerDied","Data":"6f6cced9e875a9e0da0570fd4a671df1f1a23394296a17f4a5039a081107c40a"} Jul 02 17:40:29.748118 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.747867 2535 scope.go:117] "RemoveContainer" containerID="3939410c92814620331317f5d1133f4bbdf7b22beef7a797f5ed38f9b20440d9" Jul 02 17:40:29.833357 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.833334 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:40:29.908852 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908782 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-socket\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.908852 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908837 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea841ae-988b-476a-82eb-c2487870da3c-istiod-ca-cert\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908870 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-istio-token\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908898 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-certs\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908941 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea841ae-988b-476a-82eb-c2487870da3c-istio-podinfo\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908969 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-credential-socket\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.908997 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsvj4\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-kube-api-access-bsvj4\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909058 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909054 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-envoy\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909076 2535 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-data\") pod \"1ea841ae-988b-476a-82eb-c2487870da3c\" (UID: \"1ea841ae-988b-476a-82eb-c2487870da3c\") " Jul 02 17:40:29.909385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909102 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:29.909385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909251 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:29.909385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909299 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:29.909385 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909325 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea841ae-988b-476a-82eb-c2487870da3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 17:40:29.909689 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909521 2535 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:29.909689 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909569 2535 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea841ae-988b-476a-82eb-c2487870da3c-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:29.909689 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909591 2535 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:29.909689 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.909609 2535 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:29.910192 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.910164 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:29.911155 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.911132 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ea841ae-988b-476a-82eb-c2487870da3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 17:40:29.911240 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.911184 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-kube-api-access-bsvj4" (OuterVolumeSpecName: "kube-api-access-bsvj4") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "kube-api-access-bsvj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:40:29.911240 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.911200 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 17:40:29.911311 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:29.911282 2535 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ea841ae-988b-476a-82eb-c2487870da3c" (UID: "1ea841ae-988b-476a-82eb-c2487870da3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 17:40:30.011009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.010960 2535 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:30.011009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.011004 2535 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea841ae-988b-476a-82eb-c2487870da3c-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:30.011009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.011013 2535 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsvj4\" (UniqueName: \"kubernetes.io/projected/1ea841ae-988b-476a-82eb-c2487870da3c-kube-api-access-bsvj4\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:30.011009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.011022 2535 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:30.011009 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.011031 2535 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea841ae-988b-476a-82eb-c2487870da3c-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jul 02 17:40:30.291968 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.291936 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716875-h9l8l_8aab71ba-8c96-4c1c-800c-f8a8907925b5/cleanup/0.log" Jul 02 17:40:30.406489 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.406466 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716890-5vmvv_a04bc0f1-a395-4302-9192-e96b0fc06041/cleanup/0.log" Jul 02 17:40:30.650131 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.650051 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hcn5t_314271a6-5af4-4bb8-8ff7-d3be62a71a8e/server/0.log" Jul 02 17:40:30.755188 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.755161 2535 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" Jul 02 17:40:30.755598 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.755163 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml" event={"ID":"1ea841ae-988b-476a-82eb-c2487870da3c","Type":"ContainerDied","Data":"58af0e9534f9423f2b4fdbd8f28468b00fcbf423e924d1ff5bed8ccae1d6e497"} Jul 02 17:40:30.755598 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.755288 2535 scope.go:117] "RemoveContainer" containerID="6f6cced9e875a9e0da0570fd4a671df1f1a23394296a17f4a5039a081107c40a" Jul 02 17:40:30.772390 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.772367 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tkgqw_17d8d125-8d2f-45d8-9721-54136ad6db11/manager/0.log" Jul 02 17:40:30.773930 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.773910 2535 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml"] Jul 02 17:40:30.777145 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:30.777124 2535 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d87672-openshift-default-87b88db5f-rx6ml"] Jul 02 17:40:31.012359 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:31.012331 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-hvqhx_c310c8e6-58d6-49b9-8453-b1fad4cae299/copy-manifests/0.log" Jul 02 17:40:31.019562 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:31.019526 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-hvqhx_c310c8e6-58d6-49b9-8453-b1fad4cae299/manager/0.log" Jul 02 17:40:32.043812 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.043776 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7_51c1b4d4-5774-42c8-bf81-7b7968dc0eb5/pull/0.log" Jul 02 17:40:32.050079 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.050058 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7_51c1b4d4-5774-42c8-bf81-7b7968dc0eb5/extract/0.log" Jul 02 17:40:32.056754 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.056729 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7_51c1b4d4-5774-42c8-bf81-7b7968dc0eb5/util/0.log" Jul 02 17:40:32.169827 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.169808 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c_3fa91561-81dd-4add-82c8-dcd3a6555c9b/util/0.log" Jul 02 17:40:32.176589 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.176567 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c_3fa91561-81dd-4add-82c8-dcd3a6555c9b/pull/0.log" Jul 02 17:40:32.183015 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.182996 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c_3fa91561-81dd-4add-82c8-dcd3a6555c9b/extract/0.log" Jul 02 17:40:32.295998 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.295936 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b_58cc2e0e-dc87-4458-afea-8a4992ce3125/util/0.log" Jul 02 17:40:32.303041 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.303022 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b_58cc2e0e-dc87-4458-afea-8a4992ce3125/pull/0.log" Jul 02 17:40:32.310093 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.310070 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b_58cc2e0e-dc87-4458-afea-8a4992ce3125/extract/0.log" Jul 02 17:40:32.391051 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.391018 2535 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" path="/var/lib/kubelet/pods/1ea841ae-988b-476a-82eb-c2487870da3c/volumes" Jul 02 17:40:32.434466 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.434430 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr_8d87144f-edeb-495a-9a01-10e9da1946c2/util/0.log" Jul 02 17:40:32.446328 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.446303 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr_8d87144f-edeb-495a-9a01-10e9da1946c2/pull/0.log" Jul 02 17:40:32.458101 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.458073 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr_8d87144f-edeb-495a-9a01-10e9da1946c2/extract/0.log" Jul 02 17:40:32.586686 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.586608 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5769466bd9-h6twg_b8b1760a-221a-41c9-bcd6-a7ec625322ad/authorino/0.log" Jul 02 17:40:32.831780 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:32.831752 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:33.807060 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:33.807019 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qt7t8_bb10f124-6e97-457a-a8b0-d918ad184e48/istio-proxy/0.log" Jul 02 17:40:34.021053 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:34.021021 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:34.164902 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:34.164813 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54f48b874f-hdwxn_d10e021f-cf38-45c5-bd45-81b6b399a6ae/kube-auth-proxy/0.log" Jul 02 17:40:34.651034 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:34.650997 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8d968c5f-mk6qb_f9c3da69-4e81-4847-96b1-9d04e2a823bd/router/0.log" Jul 02 17:40:35.012853 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:35.012822 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ggpvv_0ff4d029-1a25-48ca-9035-2884d16b8fa2/main/0.log" Jul 02 17:40:39.217479 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:39.217441 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:39.712249 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:39.712217 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:39.810765 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:39.810727 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:40:42.461378 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:42.461347 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4m766_445acc05-aa49-4cc4-839a-c72e7016c4a3/global-pull-secret-syncer/0.log" Jul 02 17:40:42.601447 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:42.601413 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" Jul 02 17:40:42.712115 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:42.712035 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-105.ec2.internal_50c016c0fd8f941ebe04fa7023a3cc06/haproxy/0.log" Jul 02 17:40:46.808472 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.808429 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7_51c1b4d4-5774-42c8-bf81-7b7968dc0eb5/extract/0.log" Jul 02 17:40:46.832198 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.832169 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7_51c1b4d4-5774-42c8-bf81-7b7968dc0eb5/util/0.log" Jul 02 17:40:46.862399 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.862369 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xmqq7_51c1b4d4-5774-42c8-bf81-7b7968dc0eb5/pull/0.log" Jul 02 17:40:46.903399 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.903374 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c_3fa91561-81dd-4add-82c8-dcd3a6555c9b/extract/0.log" Jul 02 17:40:46.926854 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.926834 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c_3fa91561-81dd-4add-82c8-dcd3a6555c9b/util/0.log" Jul 02 17:40:46.954813 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.954791 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c9w9c_3fa91561-81dd-4add-82c8-dcd3a6555c9b/pull/0.log" Jul 02 17:40:46.990406 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:46.990381 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b_58cc2e0e-dc87-4458-afea-8a4992ce3125/extract/0.log" Jul 02 17:40:47.037865 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:47.037836 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b_58cc2e0e-dc87-4458-afea-8a4992ce3125/util/0.log" Jul 02 17:40:47.067100 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:47.067028 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7366f5b_58cc2e0e-dc87-4458-afea-8a4992ce3125/pull/0.log" Jul 02 17:40:47.097892 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:47.097866 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr_8d87144f-edeb-495a-9a01-10e9da1946c2/extract/0.log" Jul 02 17:40:47.121582 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:47.121558 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr_8d87144f-edeb-495a-9a01-10e9da1946c2/util/0.log" Jul 02 17:40:47.144418 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:47.144389 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fzvmr_8d87144f-edeb-495a-9a01-10e9da1946c2/pull/0.log" Jul 02 17:40:47.706871 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:47.706832 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5769466bd9-h6twg_b8b1760a-221a-41c9-bcd6-a7ec625322ad/authorino/0.log" Jul 02 17:40:49.751644 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:49.751615 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-vhzt6_75207b6c-e7bf-44b4-908c-403cd6a5dac3/cluster-monitoring-operator/0.log" Jul 02 17:40:49.981175 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:49.981144 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gf4r_ffbd9ae2-8f8c-4486-8575-42cbda633793/node-exporter/0.log" Jul 02 17:40:50.002304 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:50.002279 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gf4r_ffbd9ae2-8f8c-4486-8575-42cbda633793/kube-rbac-proxy/0.log" Jul 02 17:40:50.021069 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:50.021046 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gf4r_ffbd9ae2-8f8c-4486-8575-42cbda633793/init-textfile/0.log" Jul 02 17:40:50.487469 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:50.487444 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-tqk25_4dc182f4-639f-4468-a18c-ff3129b5ff96/prometheus-operator-admission-webhook/0.log" Jul 02 17:40:52.422321 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422286 2535 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66"] Jul 02 17:40:52.422851 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422832 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422854 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422878 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422886 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422894 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422902 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422911 2535 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" Jul 02 17:40:52.422951 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.422919 2535 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" Jul 02 17:40:52.423300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.423012 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" Jul 02 17:40:52.423300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.423026 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea841ae-988b-476a-82eb-c2487870da3c" containerName="istio-proxy" Jul 02 17:40:52.423300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.423036 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" Jul 02 17:40:52.423300 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.423045 2535 memory_manager.go:368] "RemoveStaleState removing state" podUID="0347bf5f-fb29-40da-8896-cb65b5981524" containerName="istio-proxy" Jul 02 17:40:52.426308 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.426288 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.428667 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.428647 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pdk5z\"/\"openshift-service-ca.crt\"" Jul 02 17:40:52.429439 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.429417 2535 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pdk5z\"/\"default-dockercfg-lz9qx\"" Jul 02 17:40:52.429556 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.429430 2535 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pdk5z\"/\"kube-root-ca.crt\"" Jul 02 17:40:52.434005 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.433981 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66"] Jul 02 17:40:52.495597 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.495562 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-sys\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.495746 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.495601 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-podres\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.495746 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.495654 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-proc\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.495746 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.495674 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-lib-modules\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.495746 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.495702 2535 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdbv\" (UniqueName: \"kubernetes.io/projected/03f6da87-a111-4149-b8c3-e4dcf9691737-kube-api-access-xmdbv\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.521397 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.521371 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/1.log" Jul 02 17:40:52.531156 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.531130 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7l8jd_bf7fe272-a14c-42aa-af6c-d9812fcc2e34/console-operator/2.log" Jul 02 17:40:52.596229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596197 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-proc\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596229 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596232 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-lib-modules\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596259 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdbv\" (UniqueName: \"kubernetes.io/projected/03f6da87-a111-4149-b8c3-e4dcf9691737-kube-api-access-xmdbv\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596308 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-sys\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596325 2535 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-podres\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596335 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-proc\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596388 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-sys\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596384 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-lib-modules\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.596464 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.596435 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03f6da87-a111-4149-b8c3-e4dcf9691737-podres\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.604513 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.604489 2535 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdbv\" (UniqueName: \"kubernetes.io/projected/03f6da87-a111-4149-b8c3-e4dcf9691737-kube-api-access-xmdbv\") pod \"perf-node-gather-daemonset-jfc66\" (UID: \"03f6da87-a111-4149-b8c3-e4dcf9691737\") " pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.738013 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.737980 2535 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:52.873200 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:52.873174 2535 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66"] Jul 02 17:40:52.875296 ip-10-0-128-105 kubenswrapper[2535]: W0702 17:40:52.875261 2535 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod03f6da87_a111_4149_b8c3_e4dcf9691737.slice/crio-6cd618248859c5d29ab64bd225f6b924823fd0935de2c201b27279b82544fe56 WatchSource:0}: Error finding container 6cd618248859c5d29ab64bd225f6b924823fd0935de2c201b27279b82544fe56: Status 404 returned error can't find the container with id 6cd618248859c5d29ab64bd225f6b924823fd0935de2c201b27279b82544fe56 Jul 02 17:40:53.132571 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:53.132477 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-fw4pq_877b7223-2e37-4ea3-af47-27afa108efe4/download-server/0.log" Jul 02 17:40:53.703165 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:53.703139 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-nvjkq_9140028d-8a7f-4679-9b70-3f11f2251048/volume-data-source-validator/0.log" Jul 02 17:40:53.876918 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:53.876875 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" event={"ID":"03f6da87-a111-4149-b8c3-e4dcf9691737","Type":"ContainerStarted","Data":"54febdea659c835b90f74204532b2b497a8016779c73bb03dde6a422cf912685"} Jul 02 17:40:53.877144 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:53.876940 2535 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" event={"ID":"03f6da87-a111-4149-b8c3-e4dcf9691737","Type":"ContainerStarted","Data":"6cd618248859c5d29ab64bd225f6b924823fd0935de2c201b27279b82544fe56"} Jul 02 17:40:53.877144 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:53.876971 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:40:53.891830 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:53.891778 2535 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" podStartSLOduration=1.891761218 podStartE2EDuration="1.891761218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:40:53.891334213 +0000 UTC m=+2631.995352756" watchObservedRunningTime="2026-07-02 17:40:53.891761218 +0000 UTC m=+2631.995779761" Jul 02 17:40:54.754503 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:54.754469 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnvlm_1e59d903-0e6e-45b4-81ac-22102ce05577/dns/0.log" Jul 02 17:40:54.772958 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:54.772931 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnvlm_1e59d903-0e6e-45b4-81ac-22102ce05577/kube-rbac-proxy/0.log" Jul 02 17:40:54.793973 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:54.793948 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6s8q7_4aaf5b2d-da3d-47e4-beb8-918c342285a0/dns-node-resolver/0.log" Jul 02 17:40:55.348880 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:55.348852 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-967957fcf-wtfls_2b12a0ca-2e81-423b-9121-1b636d064593/registry/0.log" Jul 02 17:40:55.400003 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:55.399975 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kggjg_fcf543f6-e108-478f-8250-0e809a1753b9/node-ca/0.log" Jul 02 17:40:56.325903 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:56.325873 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qt7t8_bb10f124-6e97-457a-a8b0-d918ad184e48/istio-proxy/0.log" Jul 02 17:40:56.573935 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:56.573906 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54f48b874f-hdwxn_d10e021f-cf38-45c5-bd45-81b6b399a6ae/kube-auth-proxy/0.log" Jul 02 17:40:56.778695 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:56.778665 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8d968c5f-mk6qb_f9c3da69-4e81-4847-96b1-9d04e2a823bd/router/0.log" Jul 02 17:40:57.478144 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:57.478110 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qbngg_922c520e-3320-4d25-86be-f748bbcdd582/serve-healthcheck-canary/0.log" Jul 02 17:40:57.951698 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:57.951675 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4s5p_56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83/kube-rbac-proxy/0.log" Jul 02 17:40:57.970445 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:57.970421 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4s5p_56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83/exporter/0.log" Jul 02 17:40:57.990715 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:57.990680 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4s5p_56c7ab4b-1fe2-4440-bcb6-4121e4d5ec83/extractor/0.log" Jul 02 17:40:59.891177 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:40:59.891149 2535 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pdk5z/perf-node-gather-daemonset-jfc66" Jul 02 17:41:00.470809 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:00.470778 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716875-h9l8l_8aab71ba-8c96-4c1c-800c-f8a8907925b5/cleanup/0.log" Jul 02 17:41:00.492733 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:00.492699 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716890-5vmvv_a04bc0f1-a395-4302-9192-e96b0fc06041/cleanup/0.log" Jul 02 17:41:00.670433 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:00.670408 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hcn5t_314271a6-5af4-4bb8-8ff7-d3be62a71a8e/server/0.log" Jul 02 17:41:00.769859 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:00.769766 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tkgqw_17d8d125-8d2f-45d8-9721-54136ad6db11/manager/0.log" Jul 02 17:41:00.847497 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:00.847458 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-hvqhx_c310c8e6-58d6-49b9-8453-b1fad4cae299/manager/0.log" Jul 02 17:41:00.867499 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:00.867477 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7758cbfb47-hvqhx_c310c8e6-58d6-49b9-8453-b1fad4cae299/copy-manifests/0.log" Jul 02 17:41:02.655205 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:02.655173 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79ccbb9b6f-gghjd_c45dd8a5-49d0-4d67-a718-e9f314ff6af1/manager/0.log" Jul 02 17:41:02.706580 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:02.706558 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qml7x_b09306ac-1389-4750-8992-ed22b6195bd1/openshift-lws-operator/0.log" Jul 02 17:41:02.855530 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:02.855499 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qt7t8_bb10f124-6e97-457a-a8b0-d918ad184e48/istio-proxy/0.log" Jul 02 17:41:03.065994 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:03.065955 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54f48b874f-hdwxn_d10e021f-cf38-45c5-bd45-81b6b399a6ae/kube-auth-proxy/0.log" Jul 02 17:41:03.240073 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:03.240038 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8d968c5f-mk6qb_f9c3da69-4e81-4847-96b1-9d04e2a823bd/router/0.log" Jul 02 17:41:04.406132 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:04.406097 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qt7t8_bb10f124-6e97-457a-a8b0-d918ad184e48/istio-proxy/0.log" Jul 02 17:41:04.617616 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:04.617585 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54f48b874f-hdwxn_d10e021f-cf38-45c5-bd45-81b6b399a6ae/kube-auth-proxy/0.log" Jul 02 17:41:04.797888 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:04.797857 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8d968c5f-mk6qb_f9c3da69-4e81-4847-96b1-9d04e2a823bd/router/0.log" Jul 02 17:41:07.815925 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:07.815890 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-gpf2z_42a88e60-14d8-491d-9d1d-e71c8ebe02fe/kube-storage-version-migrator-operator/1.log" Jul 02 17:41:07.817422 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:07.817400 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-gpf2z_42a88e60-14d8-491d-9d1d-e71c8ebe02fe/kube-storage-version-migrator-operator/0.log" Jul 02 17:41:08.770673 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.770645 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/kube-multus-additional-cni-plugins/0.log" Jul 02 17:41:08.790149 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.790120 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/egress-router-binary-copy/0.log" Jul 02 17:41:08.811787 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.811755 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/cni-plugins/0.log" Jul 02 17:41:08.832444 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.832416 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/bond-cni-plugin/0.log" Jul 02 17:41:08.853218 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.853191 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/routeoverride-cni/0.log" Jul 02 17:41:08.873035 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.873002 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/whereabouts-cni-bincopy/0.log" Jul 02 17:41:08.891157 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:08.891129 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7xsbc_a4b50285-ce97-4aa4-a352-13f8603f0ca6/whereabouts-cni/0.log" Jul 02 17:41:09.093092 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:09.093009 2535 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btkps_851cca5b-69a9-4277-9dec-ea72cf625217/konnectivity-agent/0.log" limit=1024 Jul 02 17:41:09.500380 ip-10-0-128-105 kubenswrapper[2535]: I0702 17:41:09.500350 2535 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ldshb_c2b82072-76b9-4e75-98de-e78f3f7b0c31/kube-multus/0.log"