Jul 10 18:27:37.940215 ip-10-0-143-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 18:27:37.940226 ip-10-0-143-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 18:27:37.940233 ip-10-0-143-133 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 18:27:37.940442 ip-10-0-143-133 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 18:27:47.612841 ip-10-0-143-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 18:27:47.612854 ip-10-0-143-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6baf32e71b5a4b3a844da228f5823e28 -- Jul 10 18:29:18.278718 ip-10-0-143-133 systemd[1]: Starting Kubernetes Kubelet... Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.739196 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745250 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745263 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745267 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745271 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745273 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745276 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745279 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:29:18.760494 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745281 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745284 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745288 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745290 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745293 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745295 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745298 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745300 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745304 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745307 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745310 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745312 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745315 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745317 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745320 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745322 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745324 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745327 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745330 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745332 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:29:18.836692 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745335 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745338 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745340 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745343 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745345 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745349 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745353 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745357 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745360 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745363 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745366 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745369 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745372 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745374 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745377 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745379 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745382 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745384 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745388 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745391 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:29:18.840623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745393 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:29:18.821967 ip-10-0-143-133 systemd[1]: Started Kubernetes Kubelet. Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745396 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745398 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745400 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745403 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745405 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745408 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745412 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745415 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745418 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745422 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745442 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745447 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745451 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745455 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745458 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745461 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745467 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:29:18.843648 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745470 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745472 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745475 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745478 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745480 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745483 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745485 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745488 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745491 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745493 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745496 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745499 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745501 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745504 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745507 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745510 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745513 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745515 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745517 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745520 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:29:18.848106 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745523 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745526 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745528 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745531 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745533 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745536 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745539 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745541 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745544 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745547 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745550 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745553 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745555 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.745558 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747447 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747456 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747461 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747464 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747467 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747470 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:29:18.851818 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747473 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747475 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747478 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747482 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747486 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747490 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747494 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747498 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747501 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747504 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747508 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747511 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747513 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747516 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747519 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747521 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747524 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747526 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747529 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:29:18.857769 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747531 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747534 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747536 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747539 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747542 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747545 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747548 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747551 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747553 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747556 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747559 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747561 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747564 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747568 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747571 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747574 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747576 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747579 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747582 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:29:18.861885 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747584 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747587 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747590 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747592 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747595 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747597 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747600 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747602 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747605 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747607 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747609 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747612 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747614 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747617 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747619 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747621 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747624 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747626 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747629 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747632 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:29:18.866883 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747636 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747638 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747641 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747643 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747646 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747648 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747651 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747654 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747656 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747659 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747661 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747664 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747666 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747669 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747671 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747674 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747677 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747679 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747682 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747684 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:29:18.871586 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747686 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747689 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747691 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747693 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747696 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747698 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747701 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747703 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747705 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747708 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747711 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747714 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747717 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747719 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.747722 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748092 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748097 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748102 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748105 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748107 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:29:19.022657 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748111 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748113 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748116 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748119 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748121 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748124 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748127 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748130 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748132 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748135 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748137 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748140 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748142 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748145 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748147 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748150 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748152 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748155 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748157 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748160 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:29:19.025618 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748163 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748166 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748168 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748173 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748176 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748179 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748181 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748184 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748187 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748190 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748192 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748195 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748198 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748200 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748203 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748205 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748208 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748210 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748213 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:29:19.031562 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748215 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748218 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748221 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748223 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748226 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748228 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748231 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748233 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748236 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748238 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748241 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748243 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748245 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748248 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748250 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748254 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748260 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748263 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748267 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:29:19.045968 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748269 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748272 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748274 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748277 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748279 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748282 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748285 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748287 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748289 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748292 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748295 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748297 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748300 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748302 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748305 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748308 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748310 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748313 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748315 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:29:19.047381 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748317 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748322 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748325 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748328 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748331 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748333 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748336 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748339 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748342 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748344 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748350 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748352 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748355 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748357 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748360 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748362 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.748365 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748447 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748454 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748461 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 18:29:19.048455 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748465 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748469 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748473 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748477 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748481 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748484 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748487 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748491 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748494 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748498 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748501 2567 flags.go:64] FLAG: --cgroup-root="" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748504 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748507 2567 flags.go:64] FLAG: --client-ca-file="" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748510 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748512 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748516 2567 flags.go:64] FLAG: --cluster-domain="" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748519 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748522 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748525 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748529 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748532 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748535 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748542 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 18:29:19.049505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748545 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748549 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748551 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748554 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748557 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748560 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748564 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748567 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748570 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748573 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748576 2567 flags.go:64] FLAG: --enable-server="true" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748579 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748584 2567 flags.go:64] FLAG: --event-burst="100" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748587 2567 flags.go:64] FLAG: --event-qps="50" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748590 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748593 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748596 2567 flags.go:64] FLAG: --eviction-hard="" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748599 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748602 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748605 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748608 2567 flags.go:64] FLAG: --eviction-soft="" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748611 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748614 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748617 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748620 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 18:29:19.050537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748623 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748625 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748628 2567 flags.go:64] FLAG: --feature-gates="" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748632 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748634 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748637 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748643 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748646 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748649 2567 flags.go:64] FLAG: --help="false" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748652 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-133.ec2.internal" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748655 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748658 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748661 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748665 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748668 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748671 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748674 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748677 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748679 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748682 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748685 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748688 2567 flags.go:64] FLAG: --kube-reserved="" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748691 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748694 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 18:29:19.052028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748697 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748700 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748702 2567 flags.go:64] FLAG: --lock-file="" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748706 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748709 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748712 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748717 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748720 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748723 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748726 2567 flags.go:64] FLAG: --logging-format="text" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748728 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748731 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748734 2567 flags.go:64] FLAG: --manifest-url="" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748737 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748743 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748747 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748759 2567 flags.go:64] FLAG: --max-pods="110" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748763 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748766 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748769 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748772 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748775 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748778 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748781 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748788 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 18:29:19.053070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748791 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748794 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748797 2567 flags.go:64] FLAG: --pod-cidr="" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748800 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748806 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748810 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748813 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748816 2567 flags.go:64] FLAG: --port="10250" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748819 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748822 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0415d91c381983ebd" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748825 2567 flags.go:64] FLAG: --qos-reserved="" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748829 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748832 2567 flags.go:64] FLAG: --register-node="true" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748836 2567 flags.go:64] FLAG: --register-with-taints="" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748839 2567 flags.go:64] FLAG: --registry-burst="10" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748843 2567 flags.go:64] FLAG: --registry-qps="5" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748846 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748848 2567 flags.go:64] FLAG: --reserved-memory="" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748852 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748855 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748859 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748863 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748867 2567 flags.go:64] FLAG: --runonce="false" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748870 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748873 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 18:29:19.054163 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748876 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748879 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748882 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748885 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748889 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748892 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748895 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748898 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748901 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748904 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748907 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748910 2567 flags.go:64] FLAG: --system-cgroups="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748912 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748918 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748920 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748923 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748927 2567 flags.go:64] FLAG: --tls-min-version="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748930 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748932 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748936 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748939 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748942 2567 flags.go:64] FLAG: --v="2" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748946 2567 flags.go:64] FLAG: --version="false" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748950 2567 flags.go:64] FLAG: --vmodule="" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748953 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 18:29:19.059724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.748957 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749088 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749092 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749096 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749100 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749103 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749105 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749108 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749111 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749114 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749116 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749119 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749122 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749124 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749127 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749129 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749132 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749134 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749137 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749139 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:29:19.061258 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749142 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749144 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749147 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749151 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749154 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749157 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749160 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749163 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749165 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749168 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749170 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749173 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749175 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749178 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749180 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749184 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749189 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749191 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749194 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:29:19.073134 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749196 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749199 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749201 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749204 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749207 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749209 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749212 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749214 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749217 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749219 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749222 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749224 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749227 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749230 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749233 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749237 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749241 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749244 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749247 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:29:19.074170 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749250 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749252 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749255 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749258 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749261 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749263 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749265 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749268 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749270 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749274 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749278 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749281 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749284 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749287 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749289 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749292 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749295 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749297 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749300 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749302 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:29:19.075189 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749305 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749307 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749310 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749313 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749315 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749318 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749320 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749323 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749325 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749328 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749330 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749332 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749335 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749338 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749340 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749343 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749345 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749348 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749350 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749353 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:29:19.076243 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749355 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.749359 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.750153 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.758500 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.758517 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.759305 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.759314 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759373 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759377 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759381 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759385 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759388 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759391 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759394 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:29:19.077271 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759396 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759400 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759404 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759408 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759411 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759414 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759416 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759419 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759422 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759425 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759444 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759447 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759450 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759453 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759456 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759459 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759461 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759464 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759467 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759470 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:29:19.177066 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759473 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759476 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759479 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759482 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759485 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759487 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759490 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759493 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759496 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759499 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759502 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759507 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759509 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759512 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759515 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759517 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759520 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759523 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759525 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:29:19.177987 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759529 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759531 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759534 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759537 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759539 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759542 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759545 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759547 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759550 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759553 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759556 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759558 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759561 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759563 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759566 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759569 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759571 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759574 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759576 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:29:19.178994 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759579 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759583 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759586 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759589 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759591 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759595 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759598 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759601 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759604 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759606 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759609 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759612 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759616 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759619 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759623 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759626 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759628 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759631 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759634 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:29:19.180020 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759636 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759639 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759641 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759644 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759647 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759649 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759652 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759654 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759657 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759660 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759662 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759665 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759668 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759671 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759673 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:29:19.181049 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.759678 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759795 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759800 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759803 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759807 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759810 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759812 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759815 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759818 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759821 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759823 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759826 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759828 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759832 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759834 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759837 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759840 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759842 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759845 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759847 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:29:19.182037 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759852 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759854 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759857 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759859 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759862 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759865 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759868 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759870 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759873 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759875 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759878 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759881 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759883 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759886 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759888 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759891 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759897 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759899 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759902 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759904 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:29:19.183079 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759907 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759909 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759912 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759915 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759917 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759919 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759923 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759926 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759929 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759933 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759937 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759940 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759945 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759947 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759951 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759953 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759957 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759959 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759962 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:29:19.184091 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759965 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759967 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759972 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759975 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759978 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759981 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759983 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759986 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759989 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759993 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759996 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.759998 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760001 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760004 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760006 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760009 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760011 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760014 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760017 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760020 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:29:19.185123 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760024 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760026 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760029 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760032 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760034 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760039 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760041 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760043 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760046 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760049 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760051 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760054 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760056 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760059 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760061 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760064 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760066 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760069 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760071 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760074 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:29:19.186162 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:18.760076 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.760082 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.760198 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.762319 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.763855 2567 server.go:1019] "Starting client certificate rotation" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.763961 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.763995 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.766396 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.768594 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.777123 2567 log.go:25] "Validated CRI v1 runtime API" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.779645 2567 log.go:25] "Validated CRI v1 image API" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.780520 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 18:29:19.187174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.787062 2567 fs.go:135] Filesystem UUIDs: map[52ca16df-3ed0-485d-9caa-b93ea8245604:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b907b794-275a-455c-a829-8e4295ee9567:/dev/nvme0n1p3] Jul 10 18:29:19.187733 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.787077 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 18:29:19.187733 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.797623 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.797775 2567 manager.go:216] Machine: {Timestamp:2026-07-10 18:29:18.797269678 +0000 UTC m=+0.389741877 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3078636 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2189816f9a60a26eb6834b0e9e5453 SystemUUID:ec218981-6f9a-60a2-6eb6-834b0e9e5453 BootID:6baf32e7-1b5a-4b3a-844d-a228f5823e28 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:63:69:fa:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:63:69:fa:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:f0:1f:e1:d4:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.797870 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.797951 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.800493 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.800517 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.801985 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.801997 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.802005 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.802777 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.804553 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.807964 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808087 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808119 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808127 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808138 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808146 2567 kubelet.go:398] "Adding apiserver pod source" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808155 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 18:29:19.188639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808562 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.808580 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.813003 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815535 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815563 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815759 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815777 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815784 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815789 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815796 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.815802 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.816517 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.816524 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.816531 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.816537 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.816550 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.816558 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.817328 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4ts7j" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.817533 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.817542 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:18.818269 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:18.818415 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.821129 2567 server.go:1268] "Started kubelet" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.822370 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.823322 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.823852 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.828590 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.831900 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4ts7j" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.836917 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.837087 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:18.837508 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.842718 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.842741 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:18.844064 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848515 2567 factory.go:55] Registering systemd factory Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848526 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848548 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848802 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848531 2567 factory.go:223] Registration of the systemd container factory successfully Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848907 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.848919 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.849149 2567 factory.go:153] Registering CRI-O factory Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.849622 2567 factory.go:223] Registration of the crio container factory successfully Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.849705 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.849744 2567 factory.go:103] Registering Raw factory Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.849760 2567 manager.go:1196] Started watching for new ooms in manager Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.850801 2567 manager.go:349] Starting recovery of all containers Jul 10 18:29:19.189681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.851857 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:18.854352 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-133.ec2.internal\" not found" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.864563 2567 manager.go:354] Recovery completed Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.874034 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876155 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876188 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876198 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876806 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876816 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876832 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.876844 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.877684 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.877709 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:18.877722 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:18.944919 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.019222 2567 policy_none.go:49] "None policy: Start" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.019279 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.019294 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.020487 2567 policy_none.go:47] "Start" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.045171 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.195806 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.145799 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.307463 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.246200 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.430852 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.347008 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.447507 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453327 2567 manager.go:337] "Starting Device Plugin manager" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.453359 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453371 2567 server.go:87] "Starting device plugin registration server" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453672 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453690 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453779 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453859 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.453866 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.454352 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.454397 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.455053 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.456401 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.456457 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.456486 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:19.456525 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.458769 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.554650 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.555615 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.555644 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.555656 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.555684 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.556668 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal"] Jul 10 18:29:19.590403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:19.556727 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:20.513234 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.513105 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:24:18 +0000 UTC" deadline="2027-12-21 08:30:02.770409165 +0000 UTC" Jul 10 18:29:20.513234 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.513186 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12686h0m42.257226895s" Jul 10 18:29:20.514109 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.513266 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 18:29:20.514109 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:20.513834 2567 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://a2b932b5cd22d4c5e88d210c076d7dda-84df0612f1114fc4.elb.us-east-1.amazonaws.com:6443/api/v1/nodes\": read tcp 10.0.143.133:35506->32.193.189.142:6443: use of closed network connection" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.515191 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.515166 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:20.515753 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.515560 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:20.515753 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.515585 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:20.517242 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517226 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:20.517438 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.517504 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517456 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:20.517914 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517900 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:20.517914 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517906 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:20.518056 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517922 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:20.518056 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517928 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:20.518056 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517933 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:20.518056 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.517943 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:20.519098 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.519082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.519185 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.519112 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:20.519717 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.519700 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:20.519797 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.519726 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:20.519797 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.519736 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:20.523146 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.523130 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:29:20.528679 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.528666 2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-133.ec2.internal" not found Jul 10 18:29:20.544872 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.544859 2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-133.ec2.internal" not found Jul 10 18:29:20.545970 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:20.545957 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-133.ec2.internal\" not found" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.550019 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:20.550005 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-133.ec2.internal\" not found" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.601798 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.601778 2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-133.ec2.internal" not found Jul 10 18:29:20.613333 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.613315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21ac90e8159b4233797fca9ddafc6117-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"21ac90e8159b4233797fca9ddafc6117\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.613379 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.613341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21ac90e8159b4233797fca9ddafc6117-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"21ac90e8159b4233797fca9ddafc6117\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.613379 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.613360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69999537d9fb87b3192608c1c39c2f51-config\") pod \"kube-apiserver-proxy-ip-10-0-143-133.ec2.internal\" (UID: \"69999537d9fb87b3192608c1c39c2f51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.713672 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.713644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21ac90e8159b4233797fca9ddafc6117-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"21ac90e8159b4233797fca9ddafc6117\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.713672 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.713676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21ac90e8159b4233797fca9ddafc6117-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"21ac90e8159b4233797fca9ddafc6117\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.713864 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.713692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69999537d9fb87b3192608c1c39c2f51-config\") pod \"kube-apiserver-proxy-ip-10-0-143-133.ec2.internal\" (UID: \"69999537d9fb87b3192608c1c39c2f51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.713864 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.713741 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69999537d9fb87b3192608c1c39c2f51-config\") pod \"kube-apiserver-proxy-ip-10-0-143-133.ec2.internal\" (UID: \"69999537d9fb87b3192608c1c39c2f51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.713864 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.713750 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21ac90e8159b4233797fca9ddafc6117-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"21ac90e8159b4233797fca9ddafc6117\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.713864 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.713747 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21ac90e8159b4233797fca9ddafc6117-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"21ac90e8159b4233797fca9ddafc6117\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.714664 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.714651 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:29:20.715554 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.715539 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:29:20.715628 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.715566 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:29:20.715628 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.715580 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:29:20.715628 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.715603 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.722991 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.722977 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.723049 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:20.723000 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-133.ec2.internal\": node \"ip-10-0-143-133.ec2.internal\" not found" Jul 10 18:29:20.744588 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.744572 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.755696 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.755684 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:29:20.757308 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.757296 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.782450 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.782390 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:29:20.847627 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.847612 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Jul 10 18:29:20.853169 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:20.853155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Jul 10 18:29:21.351559 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.351526 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69999537d9fb87b3192608c1c39c2f51.slice/crio-6e319a716781d7f932897d3b07d52301ae1c553ca89c4b074e8b8d67ecb0dc6e WatchSource:0}: Error finding container 6e319a716781d7f932897d3b07d52301ae1c553ca89c4b074e8b8d67ecb0dc6e: Status 404 returned error can't find the container with id 6e319a716781d7f932897d3b07d52301ae1c553ca89c4b074e8b8d67ecb0dc6e Jul 10 18:29:21.355313 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.355300 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:29:21.513827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.513796 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 18:29:21.514471 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.513805 2567 apiserver.go:52] "Watching apiserver" Jul 10 18:29:21.517973 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.517935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" event={"ID":"69999537d9fb87b3192608c1c39c2f51","Type":"ContainerStarted","Data":"6e319a716781d7f932897d3b07d52301ae1c553ca89c4b074e8b8d67ecb0dc6e"} Jul 10 18:29:21.520892 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.520841 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:29:21.521060 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.521044 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 18:29:21.521980 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.521960 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-xp8x9","openshift-network-operator/iptables-alerter-w6pzn","openshift-ovn-kubernetes/ovnkube-node-pdh4c","kube-system/global-pull-secret-syncer-9fvjv","kube-system/konnectivity-agent-42vpq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp","openshift-cluster-node-tuning-operator/tuned-6s9sl","openshift-dns/node-resolver-775vg","openshift-image-registry/node-ca-hw782","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal","openshift-multus/network-metrics-daemon-xjl5g","kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal","openshift-multus/multus-5qkml","openshift-multus/multus-additional-cni-plugins-nktf9"] Jul 10 18:29:21.523811 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.523784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:21.523883 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.523849 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:21.524676 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.524661 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.527318 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.527298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.528414 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.528384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.528506 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.528466 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:21.529068 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.529052 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.529186 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.529172 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tg28n\"" Jul 10 18:29:21.529769 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.529757 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.530018 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.529997 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:29:21.530127 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530115 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.530222 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530209 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 18:29:21.530314 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530282 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 18:29:21.530371 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530334 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 18:29:21.530679 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530656 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.530749 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530677 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x88xd\"" Jul 10 18:29:21.530876 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.530854 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.531294 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.531072 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.531642 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.531623 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 18:29:21.531769 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.531751 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 18:29:21.531836 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.531799 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 18:29:21.532068 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.532053 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.532749 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.532683 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 18:29:21.532749 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.532720 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.533039 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.533023 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 18:29:21.533082 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.533049 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b5rxp\"" Jul 10 18:29:21.533147 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.533134 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.533213 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.533176 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hdd7r\"" Jul 10 18:29:21.533375 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.533360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.534186 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.534171 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.534307 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.534293 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.534368 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.534336 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vptlv\"" Jul 10 18:29:21.534617 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.534605 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.535794 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.535778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:21.535885 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.535865 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:21.536848 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.536832 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.536932 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.536900 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.536932 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.536919 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmbrh\"" Jul 10 18:29:21.537114 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.537101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cmcdb\"" Jul 10 18:29:21.537190 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.537174 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.537245 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.537231 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.537292 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.537275 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 18:29:21.537336 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.537310 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.539044 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.539026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.539723 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.539710 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 18:29:21.540323 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.540310 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 18:29:21.540831 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.540818 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 18:29:21.540909 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.540823 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dzwvx\"" Jul 10 18:29:21.541802 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.541786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 18:29:21.541878 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.541810 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 18:29:21.542071 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.542055 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 18:29:21.542151 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.542129 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kb7b\"" Jul 10 18:29:21.550444 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.550414 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 18:29:21.551059 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.551036 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ac90e8159b4233797fca9ddafc6117.slice/crio-19b3c4f8e60ce31249fa02df5b9e5311825b520b0cf0e7717c8ca420bcf99b89 WatchSource:0}: Error finding container 19b3c4f8e60ce31249fa02df5b9e5311825b520b0cf0e7717c8ca420bcf99b89: Status 404 returned error can't find the container with id 19b3c4f8e60ce31249fa02df5b9e5311825b520b0cf0e7717c8ca420bcf99b89 Jul 10 18:29:21.571918 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.571905 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tlpcd" Jul 10 18:29:21.585216 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.585197 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tlpcd" Jul 10 18:29:21.619790 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-var-lib-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.619881 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-node-log\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.619881 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc747\" (UniqueName: \"kubernetes.io/projected/a41e9adb-8a23-4289-acf8-4841155bd877-kube-api-access-nc747\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.619881 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwz4\" (UniqueName: \"kubernetes.io/projected/7a15aa92-be2d-4b69-986c-8c92b746c869-kube-api-access-7wwz4\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.619881 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/694767dd-6fd6-4131-a76a-9b84d1fc2f28-cni-binary-copy\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.619993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.619993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-ovnkube-config\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.619993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619951 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-var-lib-kubelet\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.619993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-cnibin\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.619993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.619988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-iptables-alerter-script\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-host-slash\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/748594fb-7124-496f-b49d-b7590bc1a75a-hosts-file\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-cni-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620070 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-etc-kubernetes\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-kubelet\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620101 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-ovn\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620121 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-modprobe-d\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-systemd\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8pw\" (UniqueName: \"kubernetes.io/projected/359c8127-f4c8-4d54-a384-844306262bc8-kube-api-access-sn8pw\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zd2p\" (UniqueName: \"kubernetes.io/projected/7e1ec905-11fb-476d-90ee-b30ba0841965-kube-api-access-9zd2p\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czxnj\" (UniqueName: \"kubernetes.io/projected/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-kube-api-access-czxnj\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-lib-modules\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-host\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-os-release\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-systemd\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-kubernetes\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysctl-d\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-run\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms8fd\" (UniqueName: \"kubernetes.io/projected/748594fb-7124-496f-b49d-b7590bc1a75a-kube-api-access-ms8fd\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8180ebf3-abdd-40c2-a59a-131a23061c5b-agent-certs\") pod \"konnectivity-agent-42vpq\" (UID: \"8180ebf3-abdd-40c2-a59a-131a23061c5b\") " pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-systemd-units\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-log-socket\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-kubelet\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-conf-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620510 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-system-cni-dir\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-run-netns\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-registration-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.620622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/359c8127-f4c8-4d54-a384-844306262bc8-serviceca\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8180ebf3-abdd-40c2-a59a-131a23061c5b-konnectivity-ca\") pod \"konnectivity-agent-42vpq\" (UID: \"8180ebf3-abdd-40c2-a59a-131a23061c5b\") " pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-k8s-cni-cncf-io\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-daemon-config\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-slash\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-cni-netd\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-kubelet-config\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-dbus\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdkn\" (UniqueName: \"kubernetes.io/projected/6177638a-f0c4-421d-b43b-7fb8c0155e20-kube-api-access-6gdkn\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-cni-bin\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-env-overrides\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-sys\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-device-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-system-cni-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-os-release\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.621007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-cni-bin\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-socket-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-netns\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-cni-multus\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.620999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-cnibin\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqzsf\" (UniqueName: \"kubernetes.io/projected/48a27935-e769-4e7e-ab12-4553871d3d8b-kube-api-access-cqzsf\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a15aa92-be2d-4b69-986c-8c92b746c869-tmp\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/359c8127-f4c8-4d54-a384-844306262bc8-host\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a41e9adb-8a23-4289-acf8-4841155bd877-ovn-node-metrics-cert\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-ovnkube-script-lib\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-tuned\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-etc-selinux\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-etc-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysctl-conf\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-hostroot\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-multus-certs\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbcw7\" (UniqueName: \"kubernetes.io/projected/694767dd-6fd6-4131-a76a-9b84d1fc2f28-kube-api-access-tbcw7\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysconfig\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.621885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/748594fb-7124-496f-b49d-b7590bc1a75a-tmp-dir\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.621885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-sys-fs\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.621885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-socket-dir-parent\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.621885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.621309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.721676 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-run-netns\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.721676 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-registration-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/359c8127-f4c8-4d54-a384-844306262bc8-serviceca\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8180ebf3-abdd-40c2-a59a-131a23061c5b-konnectivity-ca\") pod \"konnectivity-agent-42vpq\" (UID: \"8180ebf3-abdd-40c2-a59a-131a23061c5b\") " pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-k8s-cni-cncf-io\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721745 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-run-netns\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721775 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-registration-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-daemon-config\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721830 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-k8s-cni-cncf-io\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-slash\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721868 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-slash\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.721885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-cni-netd\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-kubelet-config\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-dbus\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721941 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-cni-netd\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdkn\" (UniqueName: \"kubernetes.io/projected/6177638a-f0c4-421d-b43b-7fb8c0155e20-kube-api-access-6gdkn\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-cni-bin\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.721996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-kubelet-config\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-env-overrides\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722027 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-sys\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722056 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-cni-bin\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-device-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722113 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-device-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722139 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-sys\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-dbus\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-system-cni-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-os-release\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722233 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-system-cni-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722246 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/359c8127-f4c8-4d54-a384-844306262bc8-serviceca\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.722675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722266 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-cni-bin\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722303 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-os-release\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8180ebf3-abdd-40c2-a59a-131a23061c5b-konnectivity-ca\") pod \"konnectivity-agent-42vpq\" (UID: \"8180ebf3-abdd-40c2-a59a-131a23061c5b\") " pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722335 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-cni-bin\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-socket-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722353 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-daemon-config\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-netns\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-cni-multus\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-socket-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-cnibin\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722455 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-netns\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqzsf\" (UniqueName: \"kubernetes.io/projected/48a27935-e769-4e7e-ab12-4553871d3d8b-kube-api-access-cqzsf\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722467 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-cni-multus\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-env-overrides\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722497 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-cnibin\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a15aa92-be2d-4b69-986c-8c92b746c869-tmp\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/359c8127-f4c8-4d54-a384-844306262bc8-host\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.723544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722563 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a41e9adb-8a23-4289-acf8-4841155bd877-ovn-node-metrics-cert\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-ovnkube-script-lib\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722591 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/359c8127-f4c8-4d54-a384-844306262bc8-host\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722606 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-tuned\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722614 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-etc-selinux\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-etc-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysctl-conf\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-hostroot\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722696 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-etc-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-multus-certs\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbcw7\" (UniqueName: \"kubernetes.io/projected/694767dd-6fd6-4131-a76a-9b84d1fc2f28-kube-api-access-tbcw7\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722748 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-etc-selinux\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722765 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722777 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-hostroot\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysconfig\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722816 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-run-multus-certs\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.724510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/748594fb-7124-496f-b49d-b7590bc1a75a-tmp-dir\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722842 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysctl-conf\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-sys-fs\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-socket-dir-parent\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722899 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysconfig\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-var-lib-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722950 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-socket-dir-parent\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-node-log\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc747\" (UniqueName: \"kubernetes.io/projected/a41e9adb-8a23-4289-acf8-4841155bd877-kube-api-access-nc747\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-var-lib-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwz4\" (UniqueName: \"kubernetes.io/projected/7a15aa92-be2d-4b69-986c-8c92b746c869-kube-api-access-7wwz4\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723026 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-node-log\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/694767dd-6fd6-4131-a76a-9b84d1fc2f28-cni-binary-copy\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.722935 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-sys-fs\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-ovnkube-config\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723092 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-ovnkube-script-lib\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-var-lib-kubelet\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-cnibin\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-iptables-alerter-script\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-host-slash\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723200 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/748594fb-7124-496f-b49d-b7590bc1a75a-tmp-dir\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/748594fb-7124-496f-b49d-b7590bc1a75a-hosts-file\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-cni-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-etc-kubernetes\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-kubelet\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-ovn\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-modprobe-d\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-systemd\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8pw\" (UniqueName: \"kubernetes.io/projected/359c8127-f4c8-4d54-a384-844306262bc8-kube-api-access-sn8pw\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723372 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-var-lib-kubelet\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zd2p\" (UniqueName: \"kubernetes.io/projected/7e1ec905-11fb-476d-90ee-b30ba0841965-kube-api-access-9zd2p\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:21.725978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723415 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czxnj\" (UniqueName: \"kubernetes.io/projected/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-kube-api-access-czxnj\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723485 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-cnibin\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723487 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/694767dd-6fd6-4131-a76a-9b84d1fc2f28-cni-binary-copy\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723486 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-ovn\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-lib-modules\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723535 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-etc-kubernetes\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723553 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-cni-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723569 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-openvswitch\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723602 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-host-slash\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723626 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-lib-modules\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723537 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-host-kubelet\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723645 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/748594fb-7124-496f-b49d-b7590bc1a75a-hosts-file\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723652 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6177638a-f0c4-421d-b43b-7fb8c0155e20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723663 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-host\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723699 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-systemd\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.726632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-os-release\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-systemd\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-kubernetes\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-run-systemd\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysctl-d\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723737 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-modprobe-d\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.723790 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-run\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723820 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-os-release\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms8fd\" (UniqueName: \"kubernetes.io/projected/748594fb-7124-496f-b49d-b7590bc1a75a-kube-api-access-ms8fd\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723821 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-kubernetes\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723860 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-run\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723737 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-host\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.723880 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:22.223838852 +0000 UTC m=+3.816311056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723894 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-sysctl-d\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8180ebf3-abdd-40c2-a59a-131a23061c5b-agent-certs\") pod \"konnectivity-agent-42vpq\" (UID: \"8180ebf3-abdd-40c2-a59a-131a23061c5b\") " pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723927 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-systemd-units\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-log-socket\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.723991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-kubelet\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-conf-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-system-cni-dir\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724078 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724116 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-host-var-lib-kubelet\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724147 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-systemd-units\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724180 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a41e9adb-8a23-4289-acf8-4841155bd877-log-socket\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724211 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a27935-e769-4e7e-ab12-4553871d3d8b-system-cni-dir\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.724241 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724251 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/694767dd-6fd6-4131-a76a-9b84d1fc2f28-multus-conf-dir\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.724289 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:29:22.224274066 +0000 UTC m=+3.816746251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724480 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-iptables-alerter-script\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724601 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a41e9adb-8a23-4289-acf8-4841155bd877-ovnkube-config\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.724725 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.725309 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48a27935-e769-4e7e-ab12-4553871d3d8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.726008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a15aa92-be2d-4b69-986c-8c92b746c869-etc-tuned\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.726022 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a15aa92-be2d-4b69-986c-8c92b746c869-tmp\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.726060 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a41e9adb-8a23-4289-acf8-4841155bd877-ovn-node-metrics-cert\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.727974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.726686 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8180ebf3-abdd-40c2-a59a-131a23061c5b-agent-certs\") pod \"konnectivity-agent-42vpq\" (UID: \"8180ebf3-abdd-40c2-a59a-131a23061c5b\") " pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.736174 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.736161 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:21.736174 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.736176 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:21.736259 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.736185 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:21.736259 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:21.736232 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:29:22.236220982 +0000 UTC m=+3.828693166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:21.739715 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.739700 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbcw7\" (UniqueName: \"kubernetes.io/projected/694767dd-6fd6-4131-a76a-9b84d1fc2f28-kube-api-access-tbcw7\") pod \"multus-5qkml\" (UID: \"694767dd-6fd6-4131-a76a-9b84d1fc2f28\") " pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.741823 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.741801 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc747\" (UniqueName: \"kubernetes.io/projected/a41e9adb-8a23-4289-acf8-4841155bd877-kube-api-access-nc747\") pod \"ovnkube-node-pdh4c\" (UID: \"a41e9adb-8a23-4289-acf8-4841155bd877\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.742880 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.742857 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8pw\" (UniqueName: \"kubernetes.io/projected/359c8127-f4c8-4d54-a384-844306262bc8-kube-api-access-sn8pw\") pod \"node-ca-hw782\" (UID: \"359c8127-f4c8-4d54-a384-844306262bc8\") " pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.742982 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.742963 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czxnj\" (UniqueName: \"kubernetes.io/projected/e43d9bfe-426f-4e7c-bc1b-b24a1b726579-kube-api-access-czxnj\") pod \"iptables-alerter-w6pzn\" (UID: \"e43d9bfe-426f-4e7c-bc1b-b24a1b726579\") " pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.743641 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.743623 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdkn\" (UniqueName: \"kubernetes.io/projected/6177638a-f0c4-421d-b43b-7fb8c0155e20-kube-api-access-6gdkn\") pod \"aws-ebs-csi-driver-node-929zp\" (UID: \"6177638a-f0c4-421d-b43b-7fb8c0155e20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.744117 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.744093 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zd2p\" (UniqueName: \"kubernetes.io/projected/7e1ec905-11fb-476d-90ee-b30ba0841965-kube-api-access-9zd2p\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:21.745467 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.745450 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqzsf\" (UniqueName: \"kubernetes.io/projected/48a27935-e769-4e7e-ab12-4553871d3d8b-kube-api-access-cqzsf\") pod \"multus-additional-cni-plugins-nktf9\" (UID: \"48a27935-e769-4e7e-ab12-4553871d3d8b\") " pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.745575 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.745560 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms8fd\" (UniqueName: \"kubernetes.io/projected/748594fb-7124-496f-b49d-b7590bc1a75a-kube-api-access-ms8fd\") pod \"node-resolver-775vg\" (UID: \"748594fb-7124-496f-b49d-b7590bc1a75a\") " pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.751118 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.751101 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwz4\" (UniqueName: \"kubernetes.io/projected/7a15aa92-be2d-4b69-986c-8c92b746c869-kube-api-access-7wwz4\") pod \"tuned-6s9sl\" (UID: \"7a15aa92-be2d-4b69-986c-8c92b746c869\") " pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.837469 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.837385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w6pzn" Jul 10 18:29:21.842523 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.842502 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:21.845977 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.845958 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43d9bfe_426f_4e7c_bc1b_b24a1b726579.slice/crio-5d4fef71246b146622d5cc981f27028aae7a4822f03a7e0dadb17020c7bc5ecf WatchSource:0}: Error finding container 5d4fef71246b146622d5cc981f27028aae7a4822f03a7e0dadb17020c7bc5ecf: Status 404 returned error can't find the container with id 5d4fef71246b146622d5cc981f27028aae7a4822f03a7e0dadb17020c7bc5ecf Jul 10 18:29:21.849617 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.849602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:21.850473 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.850449 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41e9adb_8a23_4289_acf8_4841155bd877.slice/crio-0327e17129c48bdc33f7032fb990c982c343a087ae80bc6bbb3aff702078ad63 WatchSource:0}: Error finding container 0327e17129c48bdc33f7032fb990c982c343a087ae80bc6bbb3aff702078ad63: Status 404 returned error can't find the container with id 0327e17129c48bdc33f7032fb990c982c343a087ae80bc6bbb3aff702078ad63 Jul 10 18:29:21.853996 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.853977 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" Jul 10 18:29:21.858522 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.858504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" Jul 10 18:29:21.858697 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.858679 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8180ebf3_abdd_40c2_a59a_131a23061c5b.slice/crio-c7a0d8984b31ecd2f38ee9253d7445cf9f28d1570830768a98545a3d77e7ade2 WatchSource:0}: Error finding container c7a0d8984b31ecd2f38ee9253d7445cf9f28d1570830768a98545a3d77e7ade2: Status 404 returned error can't find the container with id c7a0d8984b31ecd2f38ee9253d7445cf9f28d1570830768a98545a3d77e7ade2 Jul 10 18:29:21.861652 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.861629 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6177638a_f0c4_421d_b43b_7fb8c0155e20.slice/crio-5810713f72d8d43c9b325ef328e524e28378eb472ee74766b732ef5658ea97d6 WatchSource:0}: Error finding container 5810713f72d8d43c9b325ef328e524e28378eb472ee74766b732ef5658ea97d6: Status 404 returned error can't find the container with id 5810713f72d8d43c9b325ef328e524e28378eb472ee74766b732ef5658ea97d6 Jul 10 18:29:21.863717 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.863675 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-775vg" Jul 10 18:29:21.868969 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.868948 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hw782" Jul 10 18:29:21.869073 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.869054 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a15aa92_be2d_4b69_986c_8c92b746c869.slice/crio-fd8b696a35e29c14178db51ca4871c2e4e3659fd59dea7226ff58f81508d4bd0 WatchSource:0}: Error finding container fd8b696a35e29c14178db51ca4871c2e4e3659fd59dea7226ff58f81508d4bd0: Status 404 returned error can't find the container with id fd8b696a35e29c14178db51ca4871c2e4e3659fd59dea7226ff58f81508d4bd0 Jul 10 18:29:21.871867 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.871829 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748594fb_7124_496f_b49d_b7590bc1a75a.slice/crio-d3b5101c9b1d8aa26860ba9704ed94843b195541698c8b223d4d47300f947645 WatchSource:0}: Error finding container d3b5101c9b1d8aa26860ba9704ed94843b195541698c8b223d4d47300f947645: Status 404 returned error can't find the container with id d3b5101c9b1d8aa26860ba9704ed94843b195541698c8b223d4d47300f947645 Jul 10 18:29:21.873619 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.873604 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5qkml" Jul 10 18:29:21.876372 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.876352 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359c8127_f4c8_4d54_a384_844306262bc8.slice/crio-da6c2e258a5c2f5fee5862ff2cfeeaad21b792d27148aed4a9ae10a6b85daac7 WatchSource:0}: Error finding container da6c2e258a5c2f5fee5862ff2cfeeaad21b792d27148aed4a9ae10a6b85daac7: Status 404 returned error can't find the container with id da6c2e258a5c2f5fee5862ff2cfeeaad21b792d27148aed4a9ae10a6b85daac7 Jul 10 18:29:21.880291 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:21.880272 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nktf9" Jul 10 18:29:21.880554 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.880535 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694767dd_6fd6_4131_a76a_9b84d1fc2f28.slice/crio-e73cccfcc25f364049dd23d489cd545908fe1fcef1c434ca74f14686a4e0ffa1 WatchSource:0}: Error finding container e73cccfcc25f364049dd23d489cd545908fe1fcef1c434ca74f14686a4e0ffa1: Status 404 returned error can't find the container with id e73cccfcc25f364049dd23d489cd545908fe1fcef1c434ca74f14686a4e0ffa1 Jul 10 18:29:21.889993 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:21.889972 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a27935_e769_4e7e_ab12_4553871d3d8b.slice/crio-33dd2fe510c82a1f2a2bedaddc9cb52e463066f77bd34d7929897f846827c036 WatchSource:0}: Error finding container 33dd2fe510c82a1f2a2bedaddc9cb52e463066f77bd34d7929897f846827c036: Status 404 returned error can't find the container with id 33dd2fe510c82a1f2a2bedaddc9cb52e463066f77bd34d7929897f846827c036 Jul 10 18:29:22.228305 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.228205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:22.228305 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.228253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:22.228530 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.228346 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:22.228530 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.228356 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:22.228530 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.228409 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:29:23.228395872 +0000 UTC m=+4.820868068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:22.228530 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.228452 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:23.228419314 +0000 UTC m=+4.820891500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:22.328704 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.328667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:22.328909 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.328892 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:22.328977 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.328919 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:22.328977 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.328932 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:22.329069 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:22.328988 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:29:23.328969341 +0000 UTC m=+4.921441529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:22.532488 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.530894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42vpq" event={"ID":"8180ebf3-abdd-40c2-a59a-131a23061c5b","Type":"ContainerStarted","Data":"c7a0d8984b31ecd2f38ee9253d7445cf9f28d1570830768a98545a3d77e7ade2"} Jul 10 18:29:22.539066 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.539034 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"0327e17129c48bdc33f7032fb990c982c343a087ae80bc6bbb3aff702078ad63"} Jul 10 18:29:22.541935 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.541906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" event={"ID":"21ac90e8159b4233797fca9ddafc6117","Type":"ContainerStarted","Data":"19b3c4f8e60ce31249fa02df5b9e5311825b520b0cf0e7717c8ca420bcf99b89"} Jul 10 18:29:22.549997 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.549967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5qkml" event={"ID":"694767dd-6fd6-4131-a76a-9b84d1fc2f28","Type":"ContainerStarted","Data":"e73cccfcc25f364049dd23d489cd545908fe1fcef1c434ca74f14686a4e0ffa1"} Jul 10 18:29:22.555112 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.555085 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-775vg" event={"ID":"748594fb-7124-496f-b49d-b7590bc1a75a","Type":"ContainerStarted","Data":"d3b5101c9b1d8aa26860ba9704ed94843b195541698c8b223d4d47300f947645"} Jul 10 18:29:22.558711 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.558647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" event={"ID":"6177638a-f0c4-421d-b43b-7fb8c0155e20","Type":"ContainerStarted","Data":"5810713f72d8d43c9b325ef328e524e28378eb472ee74766b732ef5658ea97d6"} Jul 10 18:29:22.562034 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.562010 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w6pzn" event={"ID":"e43d9bfe-426f-4e7c-bc1b-b24a1b726579","Type":"ContainerStarted","Data":"5d4fef71246b146622d5cc981f27028aae7a4822f03a7e0dadb17020c7bc5ecf"} Jul 10 18:29:22.565529 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.565478 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerStarted","Data":"33dd2fe510c82a1f2a2bedaddc9cb52e463066f77bd34d7929897f846827c036"} Jul 10 18:29:22.568492 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.568470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hw782" event={"ID":"359c8127-f4c8-4d54-a384-844306262bc8","Type":"ContainerStarted","Data":"da6c2e258a5c2f5fee5862ff2cfeeaad21b792d27148aed4a9ae10a6b85daac7"} Jul 10 18:29:22.572640 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.572556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" event={"ID":"7a15aa92-be2d-4b69-986c-8c92b746c869","Type":"ContainerStarted","Data":"fd8b696a35e29c14178db51ca4871c2e4e3659fd59dea7226ff58f81508d4bd0"} Jul 10 18:29:22.587335 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.587261 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:24:21 +0000 UTC" deadline="2028-02-02 02:31:43.92935081 +0000 UTC" Jul 10 18:29:22.587335 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:22.587292 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13712h2m21.342062702s" Jul 10 18:29:23.236144 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.235194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:23.236144 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.235267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:23.236144 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.235482 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:23.236144 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.235546 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:29:25.235527663 +0000 UTC m=+6.827999852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:23.236144 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.236019 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:23.236144 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.236075 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:25.236058672 +0000 UTC m=+6.828530859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:23.337086 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.336495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:23.337086 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.336675 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:23.337086 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.336692 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:23.337086 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.336705 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:23.337086 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.336763 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:29:25.336744564 +0000 UTC m=+6.929216755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:23.458251 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.457548 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:23.458251 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.457689 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:23.458251 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.458112 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:23.458251 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.458195 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:23.461314 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.458774 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:23.461314 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:23.458906 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:23.587896 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.587787 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:24:21 +0000 UTC" deadline="2028-01-19 03:56:58.993321588 +0000 UTC" Jul 10 18:29:23.587896 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:23.587824 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13377h27m35.405502472s" Jul 10 18:29:25.254154 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:25.254116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:25.254647 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:25.254174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:25.254647 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.254318 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:25.254647 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.254371 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:29:29.25435826 +0000 UTC m=+10.846830449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:25.254647 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.254513 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:25.254647 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.254589 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:29.254544507 +0000 UTC m=+10.847016706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:25.354749 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:25.354709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:25.354928 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.354908 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:25.354989 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.354928 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:25.354989 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.354947 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:25.355072 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.355008 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:29:29.354988905 +0000 UTC m=+10.947461112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:25.459391 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:25.459358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:25.459592 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.459508 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:25.459592 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:25.459574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:25.459702 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.459649 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:25.459702 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:25.459697 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:25.459806 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:25.459777 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:27.457537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:27.457463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:27.457924 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:27.457463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:27.457924 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:27.457597 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:27.457924 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:27.457743 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:27.457924 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:27.457463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:27.457924 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:27.457851 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:29.286678 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:29.286645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:29.287150 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:29.286698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:29.287150 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.286781 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:29.287150 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.286824 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:29.287150 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.286834 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:37.286819772 +0000 UTC m=+18.879291958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:29.287150 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.286876 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:29:37.286861221 +0000 UTC m=+18.879333411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:29.387603 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:29.387570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:29.387782 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.387728 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:29.387782 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.387747 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:29.387782 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.387758 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:29.387931 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.387816 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:29:37.387797362 +0000 UTC m=+18.980269685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:29.458152 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:29.457745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:29.458152 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.457863 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:29.458152 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:29.458046 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:29.458399 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.458158 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:29.458399 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:29.458210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:29.458399 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:29.458289 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:31.457540 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:31.457504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:31.457948 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:31.457504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:31.457948 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:31.457644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:31.457948 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:31.457642 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:31.457948 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:31.457710 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:31.457948 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:31.457779 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:33.457024 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:33.456992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:33.457490 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:33.456992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:33.457490 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:33.457131 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:33.457490 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:33.456999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:33.457490 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:33.457213 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:33.457490 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:33.457270 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:35.457342 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:35.457308 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:35.457342 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:35.457325 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:35.457887 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:35.457320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:35.457887 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:35.457468 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:35.457887 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:35.457548 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:35.457887 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:35.457626 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:37.346021 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:37.345805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:37.346558 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:37.346053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:37.346558 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.345957 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:37.346558 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.346172 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:53.346145162 +0000 UTC m=+34.938617368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:37.346558 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.346205 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:37.346558 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.346250 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:29:53.346237589 +0000 UTC m=+34.938709775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:37.446762 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:37.446730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:37.446940 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.446919 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:37.446940 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.446941 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:37.447040 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.446955 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:37.447040 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.447018 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:29:53.446999153 +0000 UTC m=+35.039471339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:37.456912 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:37.456885 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:37.457074 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:37.456898 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:37.457074 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.457004 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:37.457183 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.457094 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:37.457183 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:37.457122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:37.457292 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:37.457190 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:39.457318 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:39.457285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:39.457756 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:39.457390 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:39.457756 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:39.457403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:39.457756 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:39.457555 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:39.457756 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:39.457596 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:39.457756 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:39.457691 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:41.457578 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:41.457541 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:41.457578 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:41.457567 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:41.457578 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:41.457590 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:41.458028 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:41.457707 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:41.458028 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:41.457795 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:41.458028 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:41.457854 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:42.619383 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.619145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5qkml" event={"ID":"694767dd-6fd6-4131-a76a-9b84d1fc2f28","Type":"ContainerStarted","Data":"db8a4985a798461560fe912ded40a91f7b17f2bcc381f5b6c1f3d88b1fb39de9"} Jul 10 18:29:42.620532 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.620508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-775vg" event={"ID":"748594fb-7124-496f-b49d-b7590bc1a75a","Type":"ContainerStarted","Data":"d31b9f86a72e3ec195d8a99404c7765ca4ab5d692d4cc9a5aac32de396d1fe0e"} Jul 10 18:29:42.621879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.621857 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" event={"ID":"6177638a-f0c4-421d-b43b-7fb8c0155e20","Type":"ContainerStarted","Data":"d5bc598f98114a0c81fff6272989f33b907e7fd36d4c7cf74d74dc41c5108c2b"} Jul 10 18:29:42.623096 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.623065 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" event={"ID":"69999537d9fb87b3192608c1c39c2f51","Type":"ContainerStarted","Data":"b1638e2067b41f6bb2ba278d3013e725bfc2b36879c5e5b6206437389434d365"} Jul 10 18:29:42.624398 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.624377 2567 generic.go:356] "Generic (PLEG): container finished" podID="48a27935-e769-4e7e-ab12-4553871d3d8b" containerID="62944516fd0b0535e2e99a6e16af6971592e7dd6eda70f48f11a6f823fcff5d3" exitCode=0 Jul 10 18:29:42.624512 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.624463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerDied","Data":"62944516fd0b0535e2e99a6e16af6971592e7dd6eda70f48f11a6f823fcff5d3"} Jul 10 18:29:42.625827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.625803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hw782" event={"ID":"359c8127-f4c8-4d54-a384-844306262bc8","Type":"ContainerStarted","Data":"5647ac0b64b2df85c0c0bc5e3ebcaf9406f97ac93f9c5bdd2a7110d725b2a9a0"} Jul 10 18:29:42.627220 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.627170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" event={"ID":"7a15aa92-be2d-4b69-986c-8c92b746c869","Type":"ContainerStarted","Data":"265309b8f4493f832a9100dd62ea7f804b7a0518f83a5be2928e644f04caac5e"} Jul 10 18:29:42.628555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.628530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42vpq" event={"ID":"8180ebf3-abdd-40c2-a59a-131a23061c5b","Type":"ContainerStarted","Data":"310b9ee62be8ca43f46c09ee435aa47773af7aa36008fb5c3e1eed116ad9062f"} Jul 10 18:29:42.631182 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:29:42.631528 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631511 2567 generic.go:356] "Generic (PLEG): container finished" podID="a41e9adb-8a23-4289-acf8-4841155bd877" containerID="de2cd61a5f2b84024ece392bc0e5b6d7b60e5a03b820940c428e953195b71c34" exitCode=1 Jul 10 18:29:42.631587 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"d2b7e4f43bdc6d56185c04ef9b3b9f5b62bd8006600c942b01846cf7b0a11f4c"} Jul 10 18:29:42.631636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"722a241dc6cb48f211ed0e02a06273769dcc58ea016143c60c08f82ca946de38"} Jul 10 18:29:42.631693 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"488cc96629ac52b18c5696515eb97c79c89b87acc4d80963d91477959a44dd5d"} Jul 10 18:29:42.631734 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631702 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerDied","Data":"de2cd61a5f2b84024ece392bc0e5b6d7b60e5a03b820940c428e953195b71c34"} Jul 10 18:29:42.631734 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.631732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"d943d36743cb5d9595c839152c581c7a46e91fdbd439f00d8c737df2ec941e0a"} Jul 10 18:29:42.632827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.632810 2567 generic.go:356] "Generic (PLEG): container finished" podID="21ac90e8159b4233797fca9ddafc6117" containerID="d5bbc5ac0ec0e2dd6928ad61ecdd16aa5a907a60fc4b146dad508ec55329da6f" exitCode=0 Jul 10 18:29:42.632899 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.632834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" event={"ID":"21ac90e8159b4233797fca9ddafc6117","Type":"ContainerDied","Data":"d5bbc5ac0ec0e2dd6928ad61ecdd16aa5a907a60fc4b146dad508ec55329da6f"} Jul 10 18:29:42.636458 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.636403 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5qkml" podStartSLOduration=2.764395838 podStartE2EDuration="22.636390045s" totalImagesPullingTime="19.871994207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:42.636340174 +0000 UTC m=+24.228812399" watchObservedRunningTime="2026-07-10 18:29:42.636390045 +0000 UTC m=+24.228862253" Jul 10 18:29:42.689906 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.689716 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-42vpq" podStartSLOduration=2.80038926 podStartE2EDuration="22.68969612s" totalImagesPullingTime="19.88930686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:42.689641435 +0000 UTC m=+24.282113646" watchObservedRunningTime="2026-07-10 18:29:42.68969612 +0000 UTC m=+24.282168330" Jul 10 18:29:42.690252 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.690219 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" podStartSLOduration=22.690206616 podStartE2EDuration="22.690206616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:42.671897908 +0000 UTC m=+24.264370119" watchObservedRunningTime="2026-07-10 18:29:42.690206616 +0000 UTC m=+24.282678825" Jul 10 18:29:42.711111 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.711069 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6s9sl" podStartSLOduration=2.833663479 podStartE2EDuration="22.711053632s" totalImagesPullingTime="19.877390153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:42.710870819 +0000 UTC m=+24.303343028" watchObservedRunningTime="2026-07-10 18:29:42.711053632 +0000 UTC m=+24.303525840" Jul 10 18:29:42.735093 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.735050 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-775vg" podStartSLOduration=2.916941693 podStartE2EDuration="22.735034811s" totalImagesPullingTime="19.818093118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:42.734578626 +0000 UTC m=+24.327050836" watchObservedRunningTime="2026-07-10 18:29:42.735034811 +0000 UTC m=+24.327507019" Jul 10 18:29:42.749892 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:42.749848 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hw782" podStartSLOduration=2.8790913270000003 podStartE2EDuration="22.74983063s" totalImagesPullingTime="19.870739303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:42.749645281 +0000 UTC m=+24.342117490" watchObservedRunningTime="2026-07-10 18:29:42.74983063 +0000 UTC m=+24.342302882" Jul 10 18:29:43.457398 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.457363 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:43.457666 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.457366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:43.457666 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.457493 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:43.457666 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:43.457511 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:43.457666 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:43.457614 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:43.457839 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:43.457707 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:43.637681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.637649 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:29:43.638182 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.638109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"faba43eae53b74a5a16f331dc49191cb4f8d2388fd0dd106afd451d5a5e73162"} Jul 10 18:29:43.639986 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.639962 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" event={"ID":"21ac90e8159b4233797fca9ddafc6117","Type":"ContainerStarted","Data":"15d7ff24cd66c4a38deaca209b543f81c89338d91584f4f7f4c62691e4d2f70d"} Jul 10 18:29:43.641902 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.641760 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w6pzn" event={"ID":"e43d9bfe-426f-4e7c-bc1b-b24a1b726579","Type":"ContainerStarted","Data":"2f9ca9e1b8f74dba30e5387a9b0f361e0115bd39618d4825e04004a4b50983c8"} Jul 10 18:29:43.662615 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.662570 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" podStartSLOduration=23.662551966 podStartE2EDuration="23.662551966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:43.662022852 +0000 UTC m=+25.254495061" watchObservedRunningTime="2026-07-10 18:29:43.662551966 +0000 UTC m=+25.255024176" Jul 10 18:29:43.756160 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:43.756140 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 18:29:44.526608 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:44.526515 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:29:43.756157481Z","UUID":"f9c709fe-8aa9-4df6-80dd-081c600fe11d","Handler":null,"Name":"","Endpoint":""} Jul 10 18:29:44.528304 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:44.528280 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 18:29:44.528479 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:44.528324 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 18:29:44.646848 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:44.646813 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" event={"ID":"6177638a-f0c4-421d-b43b-7fb8c0155e20","Type":"ContainerStarted","Data":"5042f30424b3b0493a8bc576e59fef6183baff2f931c40b8ba398813b963356e"} Jul 10 18:29:45.457480 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:45.457452 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:45.457705 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:45.457462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:45.457705 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:45.457567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:45.457705 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:45.457646 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:45.457705 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:45.457462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:45.457926 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:45.457743 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:45.654424 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:45.654391 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:29:45.654924 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:45.654798 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"abeec6ff9dad83a620e913719285317712df05a4a5390065056837aac9c32974"} Jul 10 18:29:46.659340 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:46.659311 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:46.659893 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:46.659871 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:46.674930 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:46.674893 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w6pzn" podStartSLOduration=6.831758112 podStartE2EDuration="26.674879294s" totalImagesPullingTime="19.843121182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:43.687468701 +0000 UTC m=+25.279940910" watchObservedRunningTime="2026-07-10 18:29:46.674879294 +0000 UTC m=+28.267351501" Jul 10 18:29:46.934751 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:46.934680 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:46.935494 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:46.935467 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-42vpq" Jul 10 18:29:47.457725 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.457540 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:47.457907 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.457540 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:47.457907 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:47.457817 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:47.457907 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.457590 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:47.457907 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:47.457890 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:47.458049 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:47.457971 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:47.660401 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.660317 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" event={"ID":"6177638a-f0c4-421d-b43b-7fb8c0155e20","Type":"ContainerStarted","Data":"829e371792556f05708b83252bbb7b0f50aae0f0c65140479b3e4f2bf057db8b"} Jul 10 18:29:47.661994 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.661971 2567 generic.go:356] "Generic (PLEG): container finished" podID="48a27935-e769-4e7e-ab12-4553871d3d8b" containerID="8f507587e4fda4fdfce5091584e085c2374a0e510d6a87de3393fb9375693cc4" exitCode=0 Jul 10 18:29:47.662104 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.662055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerDied","Data":"8f507587e4fda4fdfce5091584e085c2374a0e510d6a87de3393fb9375693cc4"} Jul 10 18:29:47.665506 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.665493 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:29:47.665872 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.665849 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"09c48e6392585ab071a7f5761df4f57ac395b72debb0c151a23f2806457328b3"} Jul 10 18:29:47.666305 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.666292 2567 scope.go:117] "RemoveContainer" containerID="de2cd61a5f2b84024ece392bc0e5b6d7b60e5a03b820940c428e953195b71c34" Jul 10 18:29:47.713487 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:47.713443 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-929zp" podStartSLOduration=3.799515403 podStartE2EDuration="27.713411998s" totalImagesPullingTime="23.913896595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:47.684005872 +0000 UTC m=+29.276478081" watchObservedRunningTime="2026-07-10 18:29:47.713411998 +0000 UTC m=+29.305884205" Jul 10 18:29:48.672122 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.671962 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:29:48.672710 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.672467 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" event={"ID":"a41e9adb-8a23-4289-acf8-4841155bd877","Type":"ContainerStarted","Data":"b6c2795ea0c5862e22d2ed1402b26b2c15d7447e35ccc9f9a4fddac8e6dc86b2"} Jul 10 18:29:48.673140 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.673119 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:48.673280 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.673187 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:48.673280 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.673235 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:48.687780 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.687755 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:48.688928 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.688908 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:29:48.701684 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:48.701644 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" podStartSLOduration=8.488488189 podStartE2EDuration="28.701629516s" totalImagesPullingTime="20.213141327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:48.701262105 +0000 UTC m=+30.293734315" watchObservedRunningTime="2026-07-10 18:29:48.701629516 +0000 UTC m=+30.294101723" Jul 10 18:29:49.052768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.052742 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9fvjv"] Jul 10 18:29:49.052985 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.052850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:49.052985 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:49.052931 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:49.055999 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.055975 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xp8x9"] Jul 10 18:29:49.056108 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.056078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:49.056194 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:49.056174 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:49.056803 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.056621 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xjl5g"] Jul 10 18:29:49.056803 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.056710 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:49.056803 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:49.056792 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:49.675990 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.675958 2567 generic.go:356] "Generic (PLEG): container finished" podID="48a27935-e769-4e7e-ab12-4553871d3d8b" containerID="9a5c1476847368ff9be44fad81b46ac24aa51b58ed721eea4c2bdbdf5b8e173f" exitCode=0 Jul 10 18:29:49.676393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:49.676037 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerDied","Data":"9a5c1476847368ff9be44fad81b46ac24aa51b58ed721eea4c2bdbdf5b8e173f"} Jul 10 18:29:50.457322 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:50.457292 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:50.457322 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:50.457307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:50.457575 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:50.457397 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:50.457575 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:50.457507 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:51.459680 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:51.459610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:51.460025 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:51.459712 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:51.683170 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:51.682989 2567 generic.go:356] "Generic (PLEG): container finished" podID="48a27935-e769-4e7e-ab12-4553871d3d8b" containerID="da1f1ab046e9a7cef59abf623eb99e3d6f839dcbcd0892552d48166bf15e5255" exitCode=0 Jul 10 18:29:51.683170 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:51.683070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerDied","Data":"da1f1ab046e9a7cef59abf623eb99e3d6f839dcbcd0892552d48166bf15e5255"} Jul 10 18:29:52.456752 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:52.456721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:52.456927 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:52.456857 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:52.456927 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:52.456891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:52.457057 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:52.456999 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:52.669125 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:52.669088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:52.758648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:52.758612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:53.213643 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:53.213612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:53.276929 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:53.276896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:53.352191 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:53.352160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:53.352385 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:53.352261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:53.352385 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.352322 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:53.352385 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.352363 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:53.352578 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.352389 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret podName:cbcbf77e-1c00-4010-bdb1-f1a7f79255cb nodeName:}" failed. No retries permitted until 2026-07-10 18:30:25.352369336 +0000 UTC m=+66.944841539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret") pod "global-pull-secret-syncer-9fvjv" (UID: "cbcbf77e-1c00-4010-bdb1-f1a7f79255cb") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:29:53.352578 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.352412 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:25.35239789 +0000 UTC m=+66.944870076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:29:53.452703 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:53.452671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:53.452921 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.452900 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:29:53.452976 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.452934 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:29:53.452976 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.452949 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vzx4n for pod openshift-network-diagnostics/network-check-target-xp8x9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:53.453054 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.453017 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n podName:074f552d-8431-48fc-8581-3e086ec3c13b nodeName:}" failed. No retries permitted until 2026-07-10 18:30:25.452996795 +0000 UTC m=+67.045468984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzx4n" (UniqueName: "kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n") pod "network-check-target-xp8x9" (UID: "074f552d-8431-48fc-8581-3e086ec3c13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:29:53.457549 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:53.457520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:53.457677 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:53.457655 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjl5g" podUID="7e1ec905-11fb-476d-90ee-b30ba0841965" Jul 10 18:29:54.457038 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.457012 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:54.457405 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.457012 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:54.457405 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:54.457160 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp8x9" podUID="074f552d-8431-48fc-8581-3e086ec3c13b" Jul 10 18:29:54.457405 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:54.457181 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fvjv" podUID="cbcbf77e-1c00-4010-bdb1-f1a7f79255cb" Jul 10 18:29:54.671883 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.671839 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeReady" Jul 10 18:29:54.672051 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.671990 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 18:29:54.718768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.718689 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wq99l"] Jul 10 18:29:54.737797 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.737632 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nrmhh"] Jul 10 18:29:54.737949 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.737806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.739939 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.739912 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 18:29:54.740320 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.740000 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 18:29:54.740320 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.740293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf98r\"" Jul 10 18:29:54.753569 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.753545 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wq99l"] Jul 10 18:29:54.753696 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.753590 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrmhh"] Jul 10 18:29:54.753696 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.753669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:54.756146 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.756126 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 18:29:54.756252 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.756180 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 18:29:54.756252 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.756210 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ccz8c\"" Jul 10 18:29:54.756585 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.756567 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 18:29:54.761103 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.761001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4efbf632-c810-4b02-83e6-44a901c22bb2-tmp-dir\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.761103 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.761047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzchw\" (UniqueName: \"kubernetes.io/projected/4efbf632-c810-4b02-83e6-44a901c22bb2-kube-api-access-mzchw\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.761209 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.761108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.761401 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.761166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efbf632-c810-4b02-83e6-44a901c22bb2-config-volume\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.862666 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.862632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxf9x\" (UniqueName: \"kubernetes.io/projected/18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f-kube-api-access-qxf9x\") pod \"ingress-canary-nrmhh\" (UID: \"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f\") " pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:54.862835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.862692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4efbf632-c810-4b02-83e6-44a901c22bb2-tmp-dir\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.862835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.862719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzchw\" (UniqueName: \"kubernetes.io/projected/4efbf632-c810-4b02-83e6-44a901c22bb2-kube-api-access-mzchw\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.862835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.862755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.862835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.862796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efbf632-c810-4b02-83e6-44a901c22bb2-config-volume\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.862835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.862824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f-cert\") pod \"ingress-canary-nrmhh\" (UID: \"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f\") " pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:54.863080 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:54.862897 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:29:54.863080 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:54.862968 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:55.362945895 +0000 UTC m=+36.955418083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:29:54.863193 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.863113 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4efbf632-c810-4b02-83e6-44a901c22bb2-tmp-dir\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.863447 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.863409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efbf632-c810-4b02-83e6-44a901c22bb2-config-volume\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.873722 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.873694 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzchw\" (UniqueName: \"kubernetes.io/projected/4efbf632-c810-4b02-83e6-44a901c22bb2-kube-api-access-mzchw\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:54.963705 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.963664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f-cert\") pod \"ingress-canary-nrmhh\" (UID: \"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f\") " pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:54.963858 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.963733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxf9x\" (UniqueName: \"kubernetes.io/projected/18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f-kube-api-access-qxf9x\") pod \"ingress-canary-nrmhh\" (UID: \"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f\") " pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:54.966186 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.966164 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f-cert\") pod \"ingress-canary-nrmhh\" (UID: \"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f\") " pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:54.972109 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:54.972046 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxf9x\" (UniqueName: \"kubernetes.io/projected/18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f-kube-api-access-qxf9x\") pod \"ingress-canary-nrmhh\" (UID: \"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f\") " pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:55.064837 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.064800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrmhh" Jul 10 18:29:55.114063 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.114005 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:55.174755 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.174707 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:55.367507 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.367413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:55.367668 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:55.367551 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:29:55.367668 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:55.367636 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:56.367621177 +0000 UTC m=+37.960093363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:29:55.456948 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.456919 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:29:55.461307 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.461286 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hhh94\"" Jul 10 18:29:55.461831 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:55.461335 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:29:56.167664 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.167590 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrmhh"] Jul 10 18:29:56.228931 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:29:56.228900 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d6dc42_b9e4_4ed2_aa48_c4f6ab72b38f.slice/crio-614ba2db13b94d5de435fbbcc42509318bf0e462928787bd69eee2eab17ff95d WatchSource:0}: Error finding container 614ba2db13b94d5de435fbbcc42509318bf0e462928787bd69eee2eab17ff95d: Status 404 returned error can't find the container with id 614ba2db13b94d5de435fbbcc42509318bf0e462928787bd69eee2eab17ff95d Jul 10 18:29:56.374806 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.374782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:56.374924 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:56.374911 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:29:56.374968 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:56.374960 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:29:58.374947864 +0000 UTC m=+39.967420051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:29:56.457273 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.457252 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:29:56.457444 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.457410 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:29:56.460124 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.460106 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:29:56.460874 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.460858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:29:56.460957 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.460879 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:29:56.460957 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.460950 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzdtl\"" Jul 10 18:29:56.699859 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.699765 2567 generic.go:356] "Generic (PLEG): container finished" podID="48a27935-e769-4e7e-ab12-4553871d3d8b" containerID="d96621b291a9dcf5f86985fe2325601b9df021c16196cd4f6c0c77c950db3cdc" exitCode=0 Jul 10 18:29:56.699859 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.699841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerDied","Data":"d96621b291a9dcf5f86985fe2325601b9df021c16196cd4f6c0c77c950db3cdc"} Jul 10 18:29:56.700935 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:56.700915 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrmhh" event={"ID":"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f","Type":"ContainerStarted","Data":"614ba2db13b94d5de435fbbcc42509318bf0e462928787bd69eee2eab17ff95d"} Jul 10 18:29:57.706820 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:57.706790 2567 generic.go:356] "Generic (PLEG): container finished" podID="48a27935-e769-4e7e-ab12-4553871d3d8b" containerID="73fa53044bf975023797cf7ca550598b8e6cdf12fffbd28aafe7791b5b89eae9" exitCode=0 Jul 10 18:29:57.707207 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:57.706859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerDied","Data":"73fa53044bf975023797cf7ca550598b8e6cdf12fffbd28aafe7791b5b89eae9"} Jul 10 18:29:58.387728 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:58.387683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:29:58.387904 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:58.387872 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:29:58.387973 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:29:58.387953 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:02.387935153 +0000 UTC m=+43.980407342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:29:58.712385 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:58.712361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nktf9" event={"ID":"48a27935-e769-4e7e-ab12-4553871d3d8b","Type":"ContainerStarted","Data":"b6b79576fdc4b660be329c856fd67673194549214bdc836ff189cb10248e5786"} Jul 10 18:29:58.735505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:58.735454 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nktf9" podStartSLOduration=8.169984198 podStartE2EDuration="38.735410176s" totalImagesPullingTime="30.565425978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:58.733989289 +0000 UTC m=+40.326461498" watchObservedRunningTime="2026-07-10 18:29:58.735410176 +0000 UTC m=+40.327882386" Jul 10 18:29:58.860324 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:58.860290 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:58.961296 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:58.961074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:29:59.716414 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:59.716376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrmhh" event={"ID":"18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f","Type":"ContainerStarted","Data":"56b028e139a9d80ae11454d3e574ca1637abb360257df28461f65ee29397118d"} Jul 10 18:29:59.731728 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:59.731678 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nrmhh" podStartSLOduration=3.277009309 podStartE2EDuration="5.731660861s" totalImagesPullingTime="2.454651552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:59.731026901 +0000 UTC m=+41.323499131" watchObservedRunningTime="2026-07-10 18:29:59.731660861 +0000 UTC m=+41.324133069" Jul 10 18:29:59.859321 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:29:59.859289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:02.202539 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:02.202503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:02.302548 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:02.302513 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:02.405451 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:02.405397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:02.415391 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:02.415361 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:30:02.415542 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:02.415526 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:30:02.415597 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:02.415587 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:10.415572191 +0000 UTC m=+52.008044378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:30:02.477699 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:02.477669 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:02.634855 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:02.634822 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:03.211674 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:03.211643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:03.276414 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:03.276363 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:03.616259 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:03.616230 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:03.686946 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:03.686917 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:10.471451 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.471383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:30:10.471917 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:10.471554 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:30:10.471917 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:10.471641 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.471621737 +0000 UTC m=+68.064093928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:30:10.771169 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.771122 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6"] Jul 10 18:30:10.788959 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.788927 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp"] Jul 10 18:30:10.789130 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.789057 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" Jul 10 18:30:10.792418 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.792396 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ddjx4\"" Jul 10 18:30:10.803112 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.803092 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6"] Jul 10 18:30:10.803234 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.803219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.805767 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.805743 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 18:30:10.805859 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.805822 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 18:30:10.805859 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.805833 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.805932 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.805822 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.805932 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.805827 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-scsps\"" Jul 10 18:30:10.821177 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.821153 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fl9nz"] Jul 10 18:30:10.821288 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.821275 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" Jul 10 18:30:10.823343 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.823319 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.823463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.823359 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.823463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.823415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fclh6\"" Jul 10 18:30:10.837671 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.837644 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq"] Jul 10 18:30:10.837804 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.837769 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.840442 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.840403 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 18:30:10.840442 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.840418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-54xv2\"" Jul 10 18:30:10.840648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.840404 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 18:30:10.840648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.840546 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.840740 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.840727 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.845660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.845636 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 18:30:10.851801 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.851780 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6"] Jul 10 18:30:10.851913 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.851813 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp"] Jul 10 18:30:10.851913 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.851832 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fl9nz"] Jul 10 18:30:10.851913 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.851851 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq"] Jul 10 18:30:10.851913 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.851869 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6"] Jul 10 18:30:10.851913 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.851893 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:10.854316 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.854298 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 18:30:10.854459 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.854301 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.854621 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.854606 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5kprl\"" Jul 10 18:30:10.854763 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.854750 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 18:30:10.854853 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.854838 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.874141 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874112 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.874141 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jtm\" (UniqueName: \"kubernetes.io/projected/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-kube-api-access-76jtm\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.874310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-serving-cert\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.874310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-config\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.874310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.874310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-tmp\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.874310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz4z7\" (UniqueName: \"kubernetes.io/projected/2c8b5881-e7c9-45f0-a0ca-38879d8e6800-kube-api-access-qz4z7\") pod \"volume-data-source-validator-78495597f6-dq4v6\" (UID: \"2c8b5881-e7c9-45f0-a0ca-38879d8e6800\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" Jul 10 18:30:10.874310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-snapshots\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.874647 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbqn\" (UniqueName: \"kubernetes.io/projected/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-kube-api-access-7xbqn\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.874647 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.874647 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.874411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48db\" (UniqueName: \"kubernetes.io/projected/8ef36de9-c1ca-44f9-b5d6-61492d1fb446-kube-api-access-j48db\") pod \"network-check-source-869dcfcdcd-82kr6\" (UID: \"8ef36de9-c1ca-44f9-b5d6-61492d1fb446\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" Jul 10 18:30:10.881017 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.880990 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs"] Jul 10 18:30:10.899788 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.899764 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-5bglq"] Jul 10 18:30:10.899941 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.899914 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:10.902251 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.902222 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 18:30:10.902618 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.902596 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.902735 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.902601 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.902972 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.902955 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 18:30:10.903060 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.902990 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j6tj8\"" Jul 10 18:30:10.921794 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.921770 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk"] Jul 10 18:30:10.921911 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.921887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:10.924135 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.924106 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 18:30:10.924135 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.924108 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.924319 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.924141 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fg9rk\"" Jul 10 18:30:10.924319 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.924116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.924319 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.924114 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 18:30:10.929107 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.929088 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 18:30:10.946025 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.945998 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ddbc69f69-59mcv"] Jul 10 18:30:10.946127 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.946118 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:10.948609 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.948591 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 18:30:10.948718 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.948637 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9f5nc\"" Jul 10 18:30:10.949029 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.948991 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.949181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.949167 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.960195 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.960175 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78bfb77584-jqn6f"] Jul 10 18:30:10.960299 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.960285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:10.962859 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.962840 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 18:30:10.962975 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.962847 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6l98j\"" Jul 10 18:30:10.962975 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.962878 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 18:30:10.962975 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.962881 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 18:30:10.971733 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.971712 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 18:30:10.974125 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5bglq"] Jul 10 18:30:10.974174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974137 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs"] Jul 10 18:30:10.974174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974152 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddbc69f69-59mcv"] Jul 10 18:30:10.974174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974164 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78bfb77584-jqn6f"] Jul 10 18:30:10.974264 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974175 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk"] Jul 10 18:30:10.974264 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974214 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:10.974721 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24e11806-feda-477a-bb30-4e2edded4542-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:10.974824 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.974824 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jtm\" (UniqueName: \"kubernetes.io/projected/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-kube-api-access-76jtm\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.974824 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-serving-cert\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.974974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzx8\" (UniqueName: \"kubernetes.io/projected/ce0239d7-8179-4d2c-968a-d61fd989d314-kube-api-access-djzx8\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:10.974974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-config\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.974974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz4z7\" (UniqueName: \"kubernetes.io/projected/2c8b5881-e7c9-45f0-a0ca-38879d8e6800-kube-api-access-qz4z7\") pod \"volume-data-source-validator-78495597f6-dq4v6\" (UID: \"2c8b5881-e7c9-45f0-a0ca-38879d8e6800\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" Jul 10 18:30:10.974974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbqn\" (UniqueName: \"kubernetes.io/projected/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-kube-api-access-7xbqn\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.974974 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:10.975215 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.974995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0239d7-8179-4d2c-968a-d61fd989d314-serving-cert\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:10.975215 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:10.975215 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:10.975215 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce0239d7-8179-4d2c-968a-d61fd989d314-config\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce0239d7-8179-4d2c-968a-d61fd989d314-trusted-ca\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-snapshots\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnv2\" (UniqueName: \"kubernetes.io/projected/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-kube-api-access-lgnv2\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg7mj\" (UniqueName: \"kubernetes.io/projected/24e11806-feda-477a-bb30-4e2edded4542-kube-api-access-hg7mj\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975395 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.975413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975402 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-tmp\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.975768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.975768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j48db\" (UniqueName: \"kubernetes.io/projected/8ef36de9-c1ca-44f9-b5d6-61492d1fb446-kube-api-access-j48db\") pod \"network-check-source-869dcfcdcd-82kr6\" (UID: \"8ef36de9-c1ca-44f9-b5d6-61492d1fb446\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" Jul 10 18:30:10.975768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.975629 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-config\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.976190 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976170 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-tmp\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.976318 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976171 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-snapshots\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.976415 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976301 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.976542 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976503 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 18:30:10.976596 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976585 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 18:30:10.976772 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 18:30:10.977003 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.976987 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4zqg5\"" Jul 10 18:30:10.977143 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.977124 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 18:30:10.977225 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.977180 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 18:30:10.977301 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.977251 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jjltm"] Jul 10 18:30:10.977461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.977424 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 18:30:10.980002 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.979966 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.980258 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.980059 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-serving-cert\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.985257 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.985235 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbqn\" (UniqueName: \"kubernetes.io/projected/1b68f1d0-1ec5-46fc-98e8-e6af46e24618-kube-api-access-7xbqn\") pod \"service-ca-operator-7695fc6c8c-2fdtp\" (UID: \"1b68f1d0-1ec5-46fc-98e8-e6af46e24618\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:10.985641 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.985619 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jtm\" (UniqueName: \"kubernetes.io/projected/e0c1fa28-c2f5-46f7-a69f-6d14b47dde88-kube-api-access-76jtm\") pod \"insights-operator-68d9dd94cf-fl9nz\" (UID: \"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88\") " pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:10.986188 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.986162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz4z7\" (UniqueName: \"kubernetes.io/projected/2c8b5881-e7c9-45f0-a0ca-38879d8e6800-kube-api-access-qz4z7\") pod \"volume-data-source-validator-78495597f6-dq4v6\" (UID: \"2c8b5881-e7c9-45f0-a0ca-38879d8e6800\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" Jul 10 18:30:10.986521 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.986498 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48db\" (UniqueName: \"kubernetes.io/projected/8ef36de9-c1ca-44f9-b5d6-61492d1fb446-kube-api-access-j48db\") pod \"network-check-source-869dcfcdcd-82kr6\" (UID: \"8ef36de9-c1ca-44f9-b5d6-61492d1fb446\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" Jul 10 18:30:10.996835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.996790 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jjltm"] Jul 10 18:30:10.997028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.996971 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:10.999238 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.999218 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 10 18:30:10.999337 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.999308 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 10 18:30:10.999464 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:10.999446 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c9fbn\"" Jul 10 18:30:11.076741 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-ca-trust-extracted\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.076741 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-stats-auth\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.076741 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.076741 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076730 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6pmb\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-kube-api-access-s6pmb\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk9wd\" (UniqueName: \"kubernetes.io/projected/28295818-cd5d-4af1-a94a-518ea8991c49-kube-api-access-zk9wd\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0239d7-8179-4d2c-968a-d61fd989d314-serving-cert\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdqrz\" (UniqueName: \"kubernetes.io/projected/27a999fb-3a32-462f-9dc2-0c42fa50bed0-kube-api-access-cdqrz\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-bound-sa-token\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076920 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-trusted-ca\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.076981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.076954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:11.077217 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.077023 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:11.077217 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.077217 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.077144 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls podName:24e11806-feda-477a-bb30-4e2edded4542 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:11.577122204 +0000 UTC m=+53.169594402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z4znq" (UID: "24e11806-feda-477a-bb30-4e2edded4542") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:11.077217 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077199 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c15740a-984f-4a75-83b3-2b74c94297de-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:11.077364 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077282 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.077364 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce0239d7-8179-4d2c-968a-d61fd989d314-config\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.077364 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-certificates\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.077531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce0239d7-8179-4d2c-968a-d61fd989d314-trusted-ca\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.077531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-image-registry-private-configuration\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.077531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnv2\" (UniqueName: \"kubernetes.io/projected/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-kube-api-access-lgnv2\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.077682 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg7mj\" (UniqueName: \"kubernetes.io/projected/24e11806-feda-477a-bb30-4e2edded4542-kube-api-access-hg7mj\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:11.077682 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-default-certificate\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.077682 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24e11806-feda-477a-bb30-4e2edded4542-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:11.077682 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-installation-pull-secrets\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.077879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.077879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077738 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.077879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.077737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:11.078146 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.078116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.078282 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.078166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzx8\" (UniqueName: \"kubernetes.io/projected/ce0239d7-8179-4d2c-968a-d61fd989d314-kube-api-access-djzx8\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.078282 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.078172 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce0239d7-8179-4d2c-968a-d61fd989d314-config\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.078282 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.078246 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce0239d7-8179-4d2c-968a-d61fd989d314-trusted-ca\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.078597 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.078573 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24e11806-feda-477a-bb30-4e2edded4542-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:11.079272 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.079253 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0239d7-8179-4d2c-968a-d61fd989d314-serving-cert\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.079346 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.079256 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.086553 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.086525 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzx8\" (UniqueName: \"kubernetes.io/projected/ce0239d7-8179-4d2c-968a-d61fd989d314-kube-api-access-djzx8\") pod \"console-operator-7866497494-5bglq\" (UID: \"ce0239d7-8179-4d2c-968a-d61fd989d314\") " pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.087127 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.087106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg7mj\" (UniqueName: \"kubernetes.io/projected/24e11806-feda-477a-bb30-4e2edded4542-kube-api-access-hg7mj\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:11.087198 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.087166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnv2\" (UniqueName: \"kubernetes.io/projected/fdfb69da-cc9b-4141-9feb-d6b1459d7b92-kube-api-access-lgnv2\") pod \"kube-storage-version-migrator-operator-799cb7f958-8hkxs\" (UID: \"fdfb69da-cc9b-4141-9feb-d6b1459d7b92\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.100102 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.100080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" Jul 10 18:30:11.109657 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.109631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:11.111549 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.111526 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" Jul 10 18:30:11.128700 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.128682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" Jul 10 18:30:11.147484 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.147444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.178920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-default-certificate\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-installation-pull-secrets\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-ca-trust-extracted\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-stats-auth\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6pmb\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-kube-api-access-s6pmb\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk9wd\" (UniqueName: \"kubernetes.io/projected/28295818-cd5d-4af1-a94a-518ea8991c49-kube-api-access-zk9wd\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179281 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdqrz\" (UniqueName: \"kubernetes.io/projected/27a999fb-3a32-462f-9dc2-0c42fa50bed0-kube-api-access-cdqrz\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-bound-sa-token\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-trusted-ca\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c15740a-984f-4a75-83b3-2b74c94297de-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.183998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-certificates\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.179501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-image-registry-private-configuration\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.179775 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.179886 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert podName:1c15740a-984f-4a75-83b3-2b74c94297de nodeName:}" failed. No retries permitted until 2026-07-10 18:30:11.679862922 +0000 UTC m=+53.272335112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jjltm" (UID: "1c15740a-984f-4a75-83b3-2b74c94297de") : secret "networking-console-plugin-cert" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.181589 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.181610 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddbc69f69-59mcv: secret "image-registry-tls" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.181668 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls podName:6751ea7f-f5f6-4fac-8cde-f25fdc3354db nodeName:}" failed. No retries permitted until 2026-07-10 18:30:11.681646109 +0000 UTC m=+53.274118319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls") pod "image-registry-6ddbc69f69-59mcv" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db") : secret "image-registry-tls" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.182102 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.182172 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:11.682153028 +0000 UTC m=+53.274625217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : secret "router-metrics-certs-default" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.182195 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c15740a-984f-4a75-83b3-2b74c94297de-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.182263 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:11.68225062 +0000 UTC m=+53.274722807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.183336 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-trusted-ca\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.183666 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-ca-trust-extracted\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.183666 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-certificates\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.183745 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:11.186879 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.183803 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls podName:27a999fb-3a32-462f-9dc2-0c42fa50bed0 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:11.683786228 +0000 UTC m=+53.276258418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls") pod "cluster-samples-operator-65db858894-nxwvk" (UID: "27a999fb-3a32-462f-9dc2-0c42fa50bed0") : secret "samples-operator-tls" not found Jul 10 18:30:11.193682 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.193600 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:11.195874 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.195821 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6pmb\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-kube-api-access-s6pmb\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.196460 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.196392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk9wd\" (UniqueName: \"kubernetes.io/projected/28295818-cd5d-4af1-a94a-518ea8991c49-kube-api-access-zk9wd\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.198947 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.198903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-bound-sa-token\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.199057 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.198957 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-default-certificate\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.200037 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.199692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdqrz\" (UniqueName: \"kubernetes.io/projected/27a999fb-3a32-462f-9dc2-0c42fa50bed0-kube-api-access-cdqrz\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:11.204231 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.201231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-image-registry-private-configuration\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.206135 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.206102 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-installation-pull-secrets\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.206973 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.206946 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-stats-auth\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.209984 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.209773 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" Jul 10 18:30:11.230407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.230291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:11.318966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.318552 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6"] Jul 10 18:30:11.342474 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.342370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp"] Jul 10 18:30:11.348556 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:11.348506 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b68f1d0_1ec5_46fc_98e8_e6af46e24618.slice/crio-8b72e723fa0b6ae5d04f5d4491173cdc8dafea3e3e7665f5297014073adcadb7 WatchSource:0}: Error finding container 8b72e723fa0b6ae5d04f5d4491173cdc8dafea3e3e7665f5297014073adcadb7: Status 404 returned error can't find the container with id 8b72e723fa0b6ae5d04f5d4491173cdc8dafea3e3e7665f5297014073adcadb7 Jul 10 18:30:11.366898 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.366266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6"] Jul 10 18:30:11.368142 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:11.368097 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8b5881_e7c9_45f0_a0ca_38879d8e6800.slice/crio-851a3630e9108f2ad05caca9b2476cb7507546bacf52c8aace119509f72c0b87 WatchSource:0}: Error finding container 851a3630e9108f2ad05caca9b2476cb7507546bacf52c8aace119509f72c0b87: Status 404 returned error can't find the container with id 851a3630e9108f2ad05caca9b2476cb7507546bacf52c8aace119509f72c0b87 Jul 10 18:30:11.397552 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.396792 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fl9nz"] Jul 10 18:30:11.402349 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:11.402311 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c1fa28_c2f5_46f7_a69f_6d14b47dde88.slice/crio-6639472c7a7f1e5ef81871bfcee1c07553e957196ba01d93f6948564730402c4 WatchSource:0}: Error finding container 6639472c7a7f1e5ef81871bfcee1c07553e957196ba01d93f6948564730402c4: Status 404 returned error can't find the container with id 6639472c7a7f1e5ef81871bfcee1c07553e957196ba01d93f6948564730402c4 Jul 10 18:30:11.416148 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.416114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs"] Jul 10 18:30:11.419157 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:11.419134 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfb69da_cc9b_4141_9feb_d6b1459d7b92.slice/crio-c09ab2d736399aec27ce93c337b1d5bc6d4063e61225b341e05db903bd94f0a1 WatchSource:0}: Error finding container c09ab2d736399aec27ce93c337b1d5bc6d4063e61225b341e05db903bd94f0a1: Status 404 returned error can't find the container with id c09ab2d736399aec27ce93c337b1d5bc6d4063e61225b341e05db903bd94f0a1 Jul 10 18:30:11.446315 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.446285 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5bglq"] Jul 10 18:30:11.449568 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:11.449538 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0239d7_8179_4d2c_968a_d61fd989d314.slice/crio-0134d05116bdae622985a66214170d0f8172d5004c60fb8eb80f4cc19ba920f9 WatchSource:0}: Error finding container 0134d05116bdae622985a66214170d0f8172d5004c60fb8eb80f4cc19ba920f9: Status 404 returned error can't find the container with id 0134d05116bdae622985a66214170d0f8172d5004c60fb8eb80f4cc19ba920f9 Jul 10 18:30:11.583461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.583357 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:11.583804 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.583529 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:11.583804 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.583593 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls podName:24e11806-feda-477a-bb30-4e2edded4542 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:12.58357714 +0000 UTC m=+54.176049336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z4znq" (UID: "24e11806-feda-477a-bb30-4e2edded4542") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:11.684114 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.684082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.684299 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.684188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:11.684299 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.684224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:11.684299 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684253 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:12.684232711 +0000 UTC m=+54.276704899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.684303 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684311 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684316 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684363 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls podName:27a999fb-3a32-462f-9dc2-0c42fa50bed0 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:12.684347679 +0000 UTC m=+54.276819884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls") pod "cluster-samples-operator-65db858894-nxwvk" (UID: "27a999fb-3a32-462f-9dc2-0c42fa50bed0") : secret "samples-operator-tls" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684385 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:12.684374499 +0000 UTC m=+54.276846691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : secret "router-metrics-certs-default" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684390 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684399 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddbc69f69-59mcv: secret "image-registry-tls" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.684420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684448 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls podName:6751ea7f-f5f6-4fac-8cde-f25fdc3354db nodeName:}" failed. No retries permitted until 2026-07-10 18:30:12.684418531 +0000 UTC m=+54.276890718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls") pod "image-registry-6ddbc69f69-59mcv" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db") : secret "image-registry-tls" not found Jul 10 18:30:11.684505 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684501 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:30:11.684853 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:11.684543 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert podName:1c15740a-984f-4a75-83b3-2b74c94297de nodeName:}" failed. No retries permitted until 2026-07-10 18:30:12.684532045 +0000 UTC m=+54.277004250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jjltm" (UID: "1c15740a-984f-4a75-83b3-2b74c94297de") : secret "networking-console-plugin-cert" not found Jul 10 18:30:11.745375 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.745335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" event={"ID":"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88","Type":"ContainerStarted","Data":"6639472c7a7f1e5ef81871bfcee1c07553e957196ba01d93f6948564730402c4"} Jul 10 18:30:11.746335 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.746313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5bglq" event={"ID":"ce0239d7-8179-4d2c-968a-d61fd989d314","Type":"ContainerStarted","Data":"0134d05116bdae622985a66214170d0f8172d5004c60fb8eb80f4cc19ba920f9"} Jul 10 18:30:11.747480 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.747450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" event={"ID":"fdfb69da-cc9b-4141-9feb-d6b1459d7b92","Type":"ContainerStarted","Data":"c09ab2d736399aec27ce93c337b1d5bc6d4063e61225b341e05db903bd94f0a1"} Jul 10 18:30:11.748526 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.748502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" event={"ID":"2c8b5881-e7c9-45f0-a0ca-38879d8e6800","Type":"ContainerStarted","Data":"851a3630e9108f2ad05caca9b2476cb7507546bacf52c8aace119509f72c0b87"} Jul 10 18:30:11.749516 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.749492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" event={"ID":"1b68f1d0-1ec5-46fc-98e8-e6af46e24618","Type":"ContainerStarted","Data":"8b72e723fa0b6ae5d04f5d4491173cdc8dafea3e3e7665f5297014073adcadb7"} Jul 10 18:30:11.750374 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:11.750357 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" event={"ID":"8ef36de9-c1ca-44f9-b5d6-61492d1fb446","Type":"ContainerStarted","Data":"3a11cd5bdffcac445526e7b377ef457384c398c7965ae5b15cbbd51c3cd9bf57"} Jul 10 18:30:12.595111 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:12.595026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:12.595874 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.595199 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:12.595874 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.595277 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls podName:24e11806-feda-477a-bb30-4e2edded4542 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.595254874 +0000 UTC m=+56.187727064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z4znq" (UID: "24e11806-feda-477a-bb30-4e2edded4542") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:12.695832 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:12.695797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:12.696008 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:12.695850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:12.696008 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:12.695879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:12.696008 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:12.695932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:12.696008 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:12.695993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696189 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.696168493 +0000 UTC m=+56.288640681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696242 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696453 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696474 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddbc69f69-59mcv: secret "image-registry-tls" not found Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696508 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls podName:27a999fb-3a32-462f-9dc2-0c42fa50bed0 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.696488032 +0000 UTC m=+56.288960217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls") pod "cluster-samples-operator-65db858894-nxwvk" (UID: "27a999fb-3a32-462f-9dc2-0c42fa50bed0") : secret "samples-operator-tls" not found Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696290 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:12.696590 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696527 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls podName:6751ea7f-f5f6-4fac-8cde-f25fdc3354db nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.696517822 +0000 UTC m=+56.288990008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls") pod "image-registry-6ddbc69f69-59mcv" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db") : secret "image-registry-tls" not found Jul 10 18:30:12.697082 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.696393 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:30:12.698478 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.697315 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.697292754 +0000 UTC m=+56.289764943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : secret "router-metrics-certs-default" not found Jul 10 18:30:12.698618 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:12.698493 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert podName:1c15740a-984f-4a75-83b3-2b74c94297de nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.698474758 +0000 UTC m=+56.290946948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jjltm" (UID: "1c15740a-984f-4a75-83b3-2b74c94297de") : secret "networking-console-plugin-cert" not found Jul 10 18:30:13.760689 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:13.760555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" event={"ID":"2c8b5881-e7c9-45f0-a0ca-38879d8e6800","Type":"ContainerStarted","Data":"78d43d8b8e27f7bbbea403ad1730160fd61ffcc8325ee3adc27a115f3bc4ab87"} Jul 10 18:30:13.776384 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:13.776301 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dq4v6" podStartSLOduration=1.8368804619999999 podStartE2EDuration="3.776285119s" totalImagesPullingTime="1.939404657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:13.775467404 +0000 UTC m=+55.367939613" watchObservedRunningTime="2026-07-10 18:30:13.776285119 +0000 UTC m=+55.368757327" Jul 10 18:30:13.874573 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:13.874538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:13.975609 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:13.975577 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:14.618293 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:14.618251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:14.618512 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.618396 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:14.618512 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.618485 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls podName:24e11806-feda-477a-bb30-4e2edded4542 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.618467205 +0000 UTC m=+60.210939394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z4znq" (UID: "24e11806-feda-477a-bb30-4e2edded4542") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:14.719331 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:14.719298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:14.719331 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:14.719337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:14.719526 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:14.719355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:14.719526 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719477 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:14.719526 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719493 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddbc69f69-59mcv: secret "image-registry-tls" not found Jul 10 18:30:14.719619 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719545 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:30:14.719619 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:14.719485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:14.719619 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719562 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls podName:6751ea7f-f5f6-4fac-8cde-f25fdc3354db nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.719543662 +0000 UTC m=+60.312015852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls") pod "image-registry-6ddbc69f69-59mcv" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db") : secret "image-registry-tls" not found Jul 10 18:30:14.719619 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719566 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:14.719619 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719593 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert podName:1c15740a-984f-4a75-83b3-2b74c94297de nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.71957622 +0000 UTC m=+60.312048406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jjltm" (UID: "1c15740a-984f-4a75-83b3-2b74c94297de") : secret "networking-console-plugin-cert" not found Jul 10 18:30:14.719774 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719478 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:14.719774 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719631 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls podName:27a999fb-3a32-462f-9dc2-0c42fa50bed0 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.719619445 +0000 UTC m=+60.312091634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls") pod "cluster-samples-operator-65db858894-nxwvk" (UID: "27a999fb-3a32-462f-9dc2-0c42fa50bed0") : secret "samples-operator-tls" not found Jul 10 18:30:14.719774 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719697 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.719682463 +0000 UTC m=+60.312154656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : secret "router-metrics-certs-default" not found Jul 10 18:30:14.719774 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:14.719719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:14.719906 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:14.719821 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.719811787 +0000 UTC m=+60.312283986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:15.148989 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:15.148953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:15.202947 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:15.202912 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:16.444273 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:16.444244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:16.498487 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:16.498452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:18.656058 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.656018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:18.656549 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.656216 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:18.656549 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.656300 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls podName:24e11806-feda-477a-bb30-4e2edded4542 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.656279636 +0000 UTC m=+68.248751825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z4znq" (UID: "24e11806-feda-477a-bb30-4e2edded4542") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:18.756598 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.756555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:18.756769 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.756667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:18.756769 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.756701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:18.756769 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.756727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:18.756769 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756748 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.756722003 +0000 UTC m=+68.349194195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756805 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756814 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756828 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddbc69f69-59mcv: secret "image-registry-tls" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756826 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756847 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.756835224 +0000 UTC m=+68.349307417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : secret "router-metrics-certs-default" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.756830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756878 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls podName:6751ea7f-f5f6-4fac-8cde-f25fdc3354db nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.756860366 +0000 UTC m=+68.349332576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls") pod "image-registry-6ddbc69f69-59mcv" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db") : secret "image-registry-tls" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756887 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls podName:27a999fb-3a32-462f-9dc2-0c42fa50bed0 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.756886447 +0000 UTC m=+68.349358636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls") pod "cluster-samples-operator-65db858894-nxwvk" (UID: "27a999fb-3a32-462f-9dc2-0c42fa50bed0") : secret "samples-operator-tls" not found Jul 10 18:30:18.756979 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:18.756922 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert podName:1c15740a-984f-4a75-83b3-2b74c94297de nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.756911832 +0000 UTC m=+68.349384019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jjltm" (UID: "1c15740a-984f-4a75-83b3-2b74c94297de") : secret "networking-console-plugin-cert" not found Jul 10 18:30:18.776095 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.776063 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" event={"ID":"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88","Type":"ContainerStarted","Data":"01feb98fefe76dba68a44fbccbf6e48a3cee399d0843ae5eabf5d4610d44c09d"} Jul 10 18:30:18.777849 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.777827 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/0.log" Jul 10 18:30:18.777980 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.777867 2567 generic.go:356] "Generic (PLEG): container finished" podID="ce0239d7-8179-4d2c-968a-d61fd989d314" containerID="0e98bc803fede1c5065d1636d085abf1785d1663a34c8062daae5541bbf28a27" exitCode=255 Jul 10 18:30:18.777980 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.777959 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5bglq" event={"ID":"ce0239d7-8179-4d2c-968a-d61fd989d314","Type":"ContainerDied","Data":"0e98bc803fede1c5065d1636d085abf1785d1663a34c8062daae5541bbf28a27"} Jul 10 18:30:18.778407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.778387 2567 scope.go:117] "RemoveContainer" containerID="0e98bc803fede1c5065d1636d085abf1785d1663a34c8062daae5541bbf28a27" Jul 10 18:30:18.780370 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.780319 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" event={"ID":"fdfb69da-cc9b-4141-9feb-d6b1459d7b92","Type":"ContainerStarted","Data":"1196a978e2284884665e4bbc43fc11dc9b71697f2a309c9f0f960d737581f8a5"} Jul 10 18:30:18.781908 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.781882 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" event={"ID":"1b68f1d0-1ec5-46fc-98e8-e6af46e24618","Type":"ContainerStarted","Data":"33ac3c077ad543c19e20dab442e85856db99de4829f6ce4ef4dfa31070206c48"} Jul 10 18:30:18.783746 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.783724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" event={"ID":"8ef36de9-c1ca-44f9-b5d6-61492d1fb446","Type":"ContainerStarted","Data":"e6ed6cdb22f359db0c7420c57138ff06a6c53833f5791f8b8221649e4eab2203"} Jul 10 18:30:18.792447 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.792379 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" podStartSLOduration=2.326652668 podStartE2EDuration="8.792362614s" totalImagesPullingTime="6.465709946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:18.790719673 +0000 UTC m=+60.383191882" watchObservedRunningTime="2026-07-10 18:30:18.792362614 +0000 UTC m=+60.384834802" Jul 10 18:30:18.810670 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.805494 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-82kr6" podStartSLOduration=2.265487252 podStartE2EDuration="8.805475144s" totalImagesPullingTime="6.539987892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:18.804852268 +0000 UTC m=+60.397324477" watchObservedRunningTime="2026-07-10 18:30:18.805475144 +0000 UTC m=+60.397947352" Jul 10 18:30:18.821841 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.821797 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" podStartSLOduration=2.303095765 podStartE2EDuration="8.821779646s" totalImagesPullingTime="6.518683881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:18.821701291 +0000 UTC m=+60.414173500" watchObservedRunningTime="2026-07-10 18:30:18.821779646 +0000 UTC m=+60.414251858" Jul 10 18:30:18.837073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:18.836899 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" podStartSLOduration=2.388615961 podStartE2EDuration="8.836879192s" totalImagesPullingTime="6.448263231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:18.835245988 +0000 UTC m=+60.427718198" watchObservedRunningTime="2026-07-10 18:30:18.836879192 +0000 UTC m=+60.429351402" Jul 10 18:30:19.215451 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.215361 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lx56t"] Jul 10 18:30:19.217772 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.217747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.223555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.220708 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54lkq\"" Jul 10 18:30:19.223555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.221096 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 18:30:19.223555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.221312 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 18:30:19.228151 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.228121 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lx56t"] Jul 10 18:30:19.250178 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.250148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:19.363589 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.363550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.363782 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.363622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13bf96a9-2334-45f2-b2f1-52bfc29af22d-data-volume\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.363782 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.363652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13bf96a9-2334-45f2-b2f1-52bfc29af22d-crio-socket\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.363782 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.363741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhzd\" (UniqueName: \"kubernetes.io/projected/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-api-access-mmhzd\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.363938 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.363819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.375342 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.375308 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:19.464296 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.464270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhzd\" (UniqueName: \"kubernetes.io/projected/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-api-access-mmhzd\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.464588 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.464561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.464691 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.464674 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:19.464747 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.464701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.464747 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.464732 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:19.964713641 +0000 UTC m=+61.557185847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : configmap "kube-rbac-proxy" not found Jul 10 18:30:19.464840 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.464792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13bf96a9-2334-45f2-b2f1-52bfc29af22d-data-volume\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.464840 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.464802 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:19.464840 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.464832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13bf96a9-2334-45f2-b2f1-52bfc29af22d-crio-socket\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.464840 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.464838 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:19.96482643 +0000 UTC m=+61.557298635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:19.465011 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.464949 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13bf96a9-2334-45f2-b2f1-52bfc29af22d-crio-socket\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.465149 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.465131 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13bf96a9-2334-45f2-b2f1-52bfc29af22d-data-volume\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.473981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.473123 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhzd\" (UniqueName: \"kubernetes.io/projected/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-api-access-mmhzd\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.660012 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.659969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:19.691679 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.691650 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc"] Jul 10 18:30:19.693993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.693951 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" Jul 10 18:30:19.696230 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.696207 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 18:30:19.696388 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.696322 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:19.696486 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.696467 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ll9mh\"" Jul 10 18:30:19.702099 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.702076 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc"] Jul 10 18:30:19.757402 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.757325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:19.767452 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.767413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bcr\" (UniqueName: \"kubernetes.io/projected/4db8b84b-614a-4082-92ab-0c5d702a2200-kube-api-access-w7bcr\") pod \"migrator-7f59b54f6c-8pvxc\" (UID: \"4db8b84b-614a-4082-92ab-0c5d702a2200\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" Jul 10 18:30:19.789579 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.789546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:30:19.790102 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.790077 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/0.log" Jul 10 18:30:19.790220 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.790124 2567 generic.go:356] "Generic (PLEG): container finished" podID="ce0239d7-8179-4d2c-968a-d61fd989d314" containerID="d23a443bc87da77146af66d2f80fe9275d0a837fa69b5f9e32660abf5402cdce" exitCode=255 Jul 10 18:30:19.790279 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.790237 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5bglq" event={"ID":"ce0239d7-8179-4d2c-968a-d61fd989d314","Type":"ContainerDied","Data":"d23a443bc87da77146af66d2f80fe9275d0a837fa69b5f9e32660abf5402cdce"} Jul 10 18:30:19.790327 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.790316 2567 scope.go:117] "RemoveContainer" containerID="0e98bc803fede1c5065d1636d085abf1785d1663a34c8062daae5541bbf28a27" Jul 10 18:30:19.790519 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.790498 2567 scope.go:117] "RemoveContainer" containerID="d23a443bc87da77146af66d2f80fe9275d0a837fa69b5f9e32660abf5402cdce" Jul 10 18:30:19.790739 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.790708 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5bglq_openshift-console-operator(ce0239d7-8179-4d2c-968a-d61fd989d314)\"" pod="openshift-console-operator/console-operator-7866497494-5bglq" podUID="ce0239d7-8179-4d2c-968a-d61fd989d314" Jul 10 18:30:19.813688 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.813658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:19.869390 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.869345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bcr\" (UniqueName: \"kubernetes.io/projected/4db8b84b-614a-4082-92ab-0c5d702a2200-kube-api-access-w7bcr\") pod \"migrator-7f59b54f6c-8pvxc\" (UID: \"4db8b84b-614a-4082-92ab-0c5d702a2200\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" Jul 10 18:30:19.880764 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.880727 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bcr\" (UniqueName: \"kubernetes.io/projected/4db8b84b-614a-4082-92ab-0c5d702a2200-kube-api-access-w7bcr\") pod \"migrator-7f59b54f6c-8pvxc\" (UID: \"4db8b84b-614a-4082-92ab-0c5d702a2200\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" Jul 10 18:30:19.970537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.970501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.970703 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:19.970641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:19.970703 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.970662 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:19.970771 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.970727 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:20.97070788 +0000 UTC m=+62.563180087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:19.970816 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.970764 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:19.970846 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:19.970830 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:20.970815287 +0000 UTC m=+62.563287478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : configmap "kube-rbac-proxy" not found Jul 10 18:30:20.004597 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.004568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" Jul 10 18:30:20.046949 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.046921 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:20.125009 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.124977 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc"] Jul 10 18:30:20.127552 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:20.127526 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db8b84b_614a_4082_92ab_0c5d702a2200.slice/crio-0022ff88a484f483f2abf863c1e9bff337d7b29adcdbb2ca80e9fefe01c7e1e8 WatchSource:0}: Error finding container 0022ff88a484f483f2abf863c1e9bff337d7b29adcdbb2ca80e9fefe01c7e1e8: Status 404 returned error can't find the container with id 0022ff88a484f483f2abf863c1e9bff337d7b29adcdbb2ca80e9fefe01c7e1e8 Jul 10 18:30:20.483254 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.483207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:20.583603 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.583567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:20.592729 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.592711 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-775vg_748594fb-7124-496f-b49d-b7590bc1a75a/dns-node-resolver/0.log" Jul 10 18:30:20.689022 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.689000 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdh4c" Jul 10 18:30:20.798484 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.798376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" event={"ID":"4db8b84b-614a-4082-92ab-0c5d702a2200","Type":"ContainerStarted","Data":"0022ff88a484f483f2abf863c1e9bff337d7b29adcdbb2ca80e9fefe01c7e1e8"} Jul 10 18:30:20.799841 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.799821 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:30:20.800162 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.800145 2567 scope.go:117] "RemoveContainer" containerID="d23a443bc87da77146af66d2f80fe9275d0a837fa69b5f9e32660abf5402cdce" Jul 10 18:30:20.800333 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:20.800313 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5bglq_openshift-console-operator(ce0239d7-8179-4d2c-968a-d61fd989d314)\"" pod="openshift-console-operator/console-operator-7866497494-5bglq" podUID="ce0239d7-8179-4d2c-968a-d61fd989d314" Jul 10 18:30:20.819936 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.819904 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:20.885537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.885496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:20.981445 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.981403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:20.981612 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:20.981524 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:20.981612 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.981543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:20.981612 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:20.981605 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:22.981585954 +0000 UTC m=+64.574058160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : configmap "kube-rbac-proxy" not found Jul 10 18:30:20.981774 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:20.981656 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:20.981774 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:20.981696 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:22.981682106 +0000 UTC m=+64.574154312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:20.986250 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:20.986221 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:21.086580 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.086402 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:21.231299 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.231264 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:21.231513 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.231332 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:21.805564 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.805527 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" event={"ID":"4db8b84b-614a-4082-92ab-0c5d702a2200","Type":"ContainerStarted","Data":"b8ded82aed6cf4a61c3d53bd20164f5783f24ed9230629c52f2c031c77543200"} Jul 10 18:30:21.805966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.805583 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" event={"ID":"4db8b84b-614a-4082-92ab-0c5d702a2200","Type":"ContainerStarted","Data":"0381d6321cd81dc4ffed4303f2525e90f931072a5ab224788a24aba3b3c9196c"} Jul 10 18:30:21.805966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.805890 2567 scope.go:117] "RemoveContainer" containerID="d23a443bc87da77146af66d2f80fe9275d0a837fa69b5f9e32660abf5402cdce" Jul 10 18:30:21.806048 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:21.806035 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5bglq_openshift-console-operator(ce0239d7-8179-4d2c-968a-d61fd989d314)\"" pod="openshift-console-operator/console-operator-7866497494-5bglq" podUID="ce0239d7-8179-4d2c-968a-d61fd989d314" Jul 10 18:30:21.820001 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.819951 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8pvxc" podStartSLOduration=1.601337563 podStartE2EDuration="2.819930817s" totalImagesPullingTime="1.218593254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:21.819099315 +0000 UTC m=+63.411571550" watchObservedRunningTime="2026-07-10 18:30:21.819930817 +0000 UTC m=+63.412403027" Jul 10 18:30:21.993380 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:21.993350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hw782_359c8127-f4c8-4d54-a384-844306262bc8/node-ca/0.log" Jul 10 18:30:22.435176 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.435139 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wz9hc"] Jul 10 18:30:22.437211 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.437190 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.439966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.439944 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 18:30:22.440374 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.440360 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 18:30:22.440967 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.440944 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9n75g\"" Jul 10 18:30:22.441030 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.440991 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 18:30:22.441069 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.440954 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 18:30:22.457495 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.457470 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wz9hc"] Jul 10 18:30:22.593829 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.593803 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrmhh_18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f/serve-healthcheck-canary/0.log" Jul 10 18:30:22.596047 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.596018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v5km\" (UniqueName: \"kubernetes.io/projected/bef69e75-4e1a-4b10-aa21-c31329e74fab-kube-api-access-5v5km\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.596185 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.596070 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bef69e75-4e1a-4b10-aa21-c31329e74fab-signing-cabundle\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.596185 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.596145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bef69e75-4e1a-4b10-aa21-c31329e74fab-signing-key\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.696838 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.696729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bef69e75-4e1a-4b10-aa21-c31329e74fab-signing-cabundle\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.696838 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.696794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bef69e75-4e1a-4b10-aa21-c31329e74fab-signing-key\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.697076 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.696924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v5km\" (UniqueName: \"kubernetes.io/projected/bef69e75-4e1a-4b10-aa21-c31329e74fab-kube-api-access-5v5km\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.697540 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.697513 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bef69e75-4e1a-4b10-aa21-c31329e74fab-signing-cabundle\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.699233 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.699202 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bef69e75-4e1a-4b10-aa21-c31329e74fab-signing-key\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.704742 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.704718 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v5km\" (UniqueName: \"kubernetes.io/projected/bef69e75-4e1a-4b10-aa21-c31329e74fab-kube-api-access-5v5km\") pod \"service-ca-79f68b9f4f-wz9hc\" (UID: \"bef69e75-4e1a-4b10-aa21-c31329e74fab\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.745830 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.745796 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" Jul 10 18:30:22.869711 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.869682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wz9hc"] Jul 10 18:30:22.872960 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:22.872933 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef69e75_4e1a_4b10_aa21_c31329e74fab.slice/crio-2db7ab1c01c40a52a55ddfcd5f13d09980943d234ebf782c822914287cf33dc5 WatchSource:0}: Error finding container 2db7ab1c01c40a52a55ddfcd5f13d09980943d234ebf782c822914287cf33dc5: Status 404 returned error can't find the container with id 2db7ab1c01c40a52a55ddfcd5f13d09980943d234ebf782c822914287cf33dc5 Jul 10 18:30:22.937337 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.937292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:22.999604 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.999573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:22.999889 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:22.999675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:22.999889 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:22.999711 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:22.999889 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:22.999791 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.999770058 +0000 UTC m=+68.592242247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : configmap "kube-rbac-proxy" not found Jul 10 18:30:22.999889 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:22.999819 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:22.999889 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:22.999874 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.999861188 +0000 UTC m=+68.592333387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:23.042958 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:23.042926 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:23.286714 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:23.286626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:23.813938 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:23.813907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" event={"ID":"bef69e75-4e1a-4b10-aa21-c31329e74fab","Type":"ContainerStarted","Data":"125ccd723812030d425197f9556279e34f9d81ec1297f537a7bad134e26ac4ab"} Jul 10 18:30:23.814094 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:23.813960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" event={"ID":"bef69e75-4e1a-4b10-aa21-c31329e74fab","Type":"ContainerStarted","Data":"2db7ab1c01c40a52a55ddfcd5f13d09980943d234ebf782c822914287cf33dc5"} Jul 10 18:30:23.830813 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:23.830747 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-wz9hc" podStartSLOduration=1.8307265579999998 podStartE2EDuration="1.830726558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:23.830418235 +0000 UTC m=+65.422890453" watchObservedRunningTime="2026-07-10 18:30:23.830726558 +0000 UTC m=+65.423198768" Jul 10 18:30:24.126504 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:24.126399 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:24.226660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:24.226625 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:24.346393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:24.346353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:24.417169 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:24.417070 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:24.528868 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:24.528830 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:25.023406 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.023374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:25.421413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.421322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:30:25.421413 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.421379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:30:25.424124 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.424102 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:30:25.424323 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.424309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:30:25.432151 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:25.432129 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 18:30:25.432261 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:25.432193 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs podName:7e1ec905-11fb-476d-90ee-b30ba0841965 nodeName:}" failed. No retries permitted until 2026-07-10 18:31:29.432176271 +0000 UTC m=+131.024648457 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs") pod "network-metrics-daemon-xjl5g" (UID: "7e1ec905-11fb-476d-90ee-b30ba0841965") : secret "metrics-daemon-secret" not found Jul 10 18:30:25.434384 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.434363 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbcbf77e-1c00-4010-bdb1-f1a7f79255cb-original-pull-secret\") pod \"global-pull-secret-syncer-9fvjv\" (UID: \"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb\") " pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:30:25.522739 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.522707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:30:25.525138 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.525110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzx4n\" (UniqueName: \"kubernetes.io/projected/074f552d-8431-48fc-8581-3e086ec3c13b-kube-api-access-vzx4n\") pod \"network-check-target-xp8x9\" (UID: \"074f552d-8431-48fc-8581-3e086ec3c13b\") " pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:30:25.581251 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.581222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fvjv" Jul 10 18:30:25.588249 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.588226 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzdtl\"" Jul 10 18:30:25.596213 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.596187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:30:25.625293 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.625260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:25.716714 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.716684 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9fvjv"] Jul 10 18:30:25.720192 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:25.720163 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcbf77e_1c00_4010_bdb1_f1a7f79255cb.slice/crio-29e7cfe08cd35a3094359a407712613544190bda95d89cea718338eababce956 WatchSource:0}: Error finding container 29e7cfe08cd35a3094359a407712613544190bda95d89cea718338eababce956: Status 404 returned error can't find the container with id 29e7cfe08cd35a3094359a407712613544190bda95d89cea718338eababce956 Jul 10 18:30:25.734289 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.734266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xp8x9"] Jul 10 18:30:25.737029 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:25.737007 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074f552d_8431_48fc_8581_3e086ec3c13b.slice/crio-47c5588157d2cc831feb0ce337ee579249957a7ec1ed2f08fd6a6472311da007 WatchSource:0}: Error finding container 47c5588157d2cc831feb0ce337ee579249957a7ec1ed2f08fd6a6472311da007: Status 404 returned error can't find the container with id 47c5588157d2cc831feb0ce337ee579249957a7ec1ed2f08fd6a6472311da007 Jul 10 18:30:25.821082 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.821048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9fvjv" event={"ID":"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb","Type":"ContainerStarted","Data":"29e7cfe08cd35a3094359a407712613544190bda95d89cea718338eababce956"} Jul 10 18:30:25.822393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.822366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xp8x9" event={"ID":"074f552d-8431-48fc-8581-3e086ec3c13b","Type":"ContainerStarted","Data":"0672629fd537271db3a03361837fe72927c382b0e1a3fdb16bd8a21a7fcb5b0e"} Jul 10 18:30:25.822507 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.822412 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xp8x9" event={"ID":"074f552d-8431-48fc-8581-3e086ec3c13b","Type":"ContainerStarted","Data":"47c5588157d2cc831feb0ce337ee579249957a7ec1ed2f08fd6a6472311da007"} Jul 10 18:30:25.822559 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.822544 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:30:25.837788 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:25.837741 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xp8x9" podStartSLOduration=65.837727473 podStartE2EDuration="1m5.837727473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:25.83714519 +0000 UTC m=+67.429617423" watchObservedRunningTime="2026-07-10 18:30:25.837727473 +0000 UTC m=+67.430199681" Jul 10 18:30:26.266166 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.266132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:26.431202 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.431166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:26.531477 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.531380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:30:26.531645 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.531537 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:30:26.531645 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.531602 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls podName:4efbf632-c810-4b02-83e6-44a901c22bb2 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:58.531580406 +0000 UTC m=+100.124052613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls") pod "dns-default-wq99l" (UID: "4efbf632-c810-4b02-83e6-44a901c22bb2") : secret "dns-default-metrics-tls" not found Jul 10 18:30:26.626344 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.626308 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:26.733144 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.733099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:26.733312 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.733285 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:26.733381 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.733370 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls podName:24e11806-feda-477a-bb30-4e2edded4542 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:42.73334806 +0000 UTC m=+84.325820250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-z4znq" (UID: "24e11806-feda-477a-bb30-4e2edded4542") : secret "cluster-monitoring-operator-tls" not found Jul 10 18:30:26.833998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.833911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:26.833998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.833952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:26.833998 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.833982 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:26.834243 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.834045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:26.834243 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834075 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:26.834243 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.834101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:26.834243 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834148 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:42.83412706 +0000 UTC m=+84.426599248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : secret "router-metrics-certs-default" not found Jul 10 18:30:26.834243 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834198 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle podName:28295818-cd5d-4af1-a94a-518ea8991c49 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:42.834182356 +0000 UTC m=+84.426654543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle") pod "router-default-78bfb77584-jqn6f" (UID: "28295818-cd5d-4af1-a94a-518ea8991c49") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:26.834516 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834301 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 18:30:26.834516 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834355 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert podName:1c15740a-984f-4a75-83b3-2b74c94297de nodeName:}" failed. No retries permitted until 2026-07-10 18:30:42.834338952 +0000 UTC m=+84.426811141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jjltm" (UID: "1c15740a-984f-4a75-83b3-2b74c94297de") : secret "networking-console-plugin-cert" not found Jul 10 18:30:26.834516 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834365 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:26.834516 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834385 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddbc69f69-59mcv: secret "image-registry-tls" not found Jul 10 18:30:26.834516 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:26.834454 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls podName:6751ea7f-f5f6-4fac-8cde-f25fdc3354db nodeName:}" failed. No retries permitted until 2026-07-10 18:30:42.834416229 +0000 UTC m=+84.426888426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls") pod "image-registry-6ddbc69f69-59mcv" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db") : secret "image-registry-tls" not found Jul 10 18:30:26.836885 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.836858 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27a999fb-3a32-462f-9dc2-0c42fa50bed0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-nxwvk\" (UID: \"27a999fb-3a32-462f-9dc2-0c42fa50bed0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:26.857835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.857806 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9f5nc\"" Jul 10 18:30:26.864533 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:26.864501 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" Jul 10 18:30:27.007314 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:27.007286 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk"] Jul 10 18:30:27.028902 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:27.028872 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:27.036377 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:27.036349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:27.036511 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:27.036478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:27.036595 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:27.036541 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:27.036595 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:27.036570 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:27.036692 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:27.036607 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:35.036590381 +0000 UTC m=+76.629062590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:27.036692 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:27.036623 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm podName:13bf96a9-2334-45f2-b2f1-52bfc29af22d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:35.036616091 +0000 UTC m=+76.629088277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lx56t" (UID: "13bf96a9-2334-45f2-b2f1-52bfc29af22d") : configmap "kube-rbac-proxy" not found Jul 10 18:30:27.089055 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:27.088989 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:27.831949 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:27.831913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" event={"ID":"27a999fb-3a32-462f-9dc2-0c42fa50bed0","Type":"ContainerStarted","Data":"c6a7786375909cff8fcba706d100bf08b40bdb16edf84783f8f5fdba35323db1"} Jul 10 18:30:28.162076 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:28.161973 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:28.262601 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:28.262565 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:28.362383 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:28.362335 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:28.462731 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:28.462646 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:28.562703 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:28.562671 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:28.827689 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:28.827624 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:29.080132 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:29.080052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:29.434686 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:29.434612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:30.224920 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.224885 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:30.429217 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.429185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:30.526724 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.526700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:30.844250 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.844162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" event={"ID":"27a999fb-3a32-462f-9dc2-0c42fa50bed0","Type":"ContainerStarted","Data":"b4e8dfb407328fbfe48331c651f65512175244caa8853d815e827129d5a0271c"} Jul 10 18:30:30.844250 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.844224 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" event={"ID":"27a999fb-3a32-462f-9dc2-0c42fa50bed0","Type":"ContainerStarted","Data":"cf55a245eebc6a02c47599ba3b0435dd7aab0056fab91085603ce32018eaa870"} Jul 10 18:30:30.845590 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.845557 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9fvjv" event={"ID":"cbcbf77e-1c00-4010-bdb1-f1a7f79255cb","Type":"ContainerStarted","Data":"223ed711cf505f67d32c884707affebc979a14d00df6670ec4bbf14777213fcc"} Jul 10 18:30:30.860352 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.860294 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-nxwvk" podStartSLOduration=17.457247121 podStartE2EDuration="20.860276573s" totalImagesPullingTime="3.403029452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:30.859912001 +0000 UTC m=+72.452384199" watchObservedRunningTime="2026-07-10 18:30:30.860276573 +0000 UTC m=+72.452748782" Jul 10 18:30:30.874033 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:30.873987 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9fvjv" podStartSLOduration=66.1420856 podStartE2EDuration="1m10.873973483s" totalImagesPullingTime="4.731887883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:30.872634277 +0000 UTC m=+72.465106485" watchObservedRunningTime="2026-07-10 18:30:30.873973483 +0000 UTC m=+72.466445692" Jul 10 18:30:31.519494 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:31.519464 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:31.572262 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:31.572233 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:31.626566 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:31.626534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:32.031580 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:32.031545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:32.219549 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:32.219515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:32.421934 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:32.421855 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:32.823858 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:32.823825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:33.423131 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:33.423097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:33.622388 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:33.622352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:33.826145 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:33.826115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:34.230827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:34.230793 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:34.633007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:34.632927 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:35.114729 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.114696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:35.115175 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.114800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:35.115423 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.115398 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13bf96a9-2334-45f2-b2f1-52bfc29af22d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:35.116951 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.116933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13bf96a9-2334-45f2-b2f1-52bfc29af22d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lx56t\" (UID: \"13bf96a9-2334-45f2-b2f1-52bfc29af22d\") " pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:35.133951 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.133926 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lx56t" Jul 10 18:30:35.278991 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.278951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lx56t"] Jul 10 18:30:35.281813 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:35.281784 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bf96a9_2334_45f2_b2f1_52bfc29af22d.slice/crio-f2ddcd099943b77ab19f7d4b2282648f5c6c7530a202e67d5643d387df0ce9a6 WatchSource:0}: Error finding container f2ddcd099943b77ab19f7d4b2282648f5c6c7530a202e67d5643d387df0ce9a6: Status 404 returned error can't find the container with id f2ddcd099943b77ab19f7d4b2282648f5c6c7530a202e67d5643d387df0ce9a6 Jul 10 18:30:35.448815 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.448720 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:35.457583 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.457562 2567 scope.go:117] "RemoveContainer" containerID="d23a443bc87da77146af66d2f80fe9275d0a837fa69b5f9e32660abf5402cdce" Jul 10 18:30:35.548518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.548482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:35.877115 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.875879 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:30:35.877115 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.875991 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5bglq" event={"ID":"ce0239d7-8179-4d2c-968a-d61fd989d314","Type":"ContainerStarted","Data":"aa2f7d83b21ec94dac0b2860cbf60053ae7a4294bd3b2e9bc15edda058ce6a22"} Jul 10 18:30:35.877115 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.877037 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:35.880143 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.880113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx56t" event={"ID":"13bf96a9-2334-45f2-b2f1-52bfc29af22d","Type":"ContainerStarted","Data":"f2ddcd099943b77ab19f7d4b2282648f5c6c7530a202e67d5643d387df0ce9a6"} Jul 10 18:30:35.896268 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:35.895466 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-5bglq" podStartSLOduration=19.47216766 podStartE2EDuration="25.895446751s" totalImagesPullingTime="6.423279091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:35.894664311 +0000 UTC m=+77.487136523" watchObservedRunningTime="2026-07-10 18:30:35.895446751 +0000 UTC m=+77.487918955" Jul 10 18:30:36.545587 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:36.545559 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-5bglq" Jul 10 18:30:36.718090 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:36.718050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:36.819310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:36.819219 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:36.876503 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:36.876465 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:37.022051 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:37.022020 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:37.205400 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:37.205321 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:37.400701 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:37.400671 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:37.477884 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:37.477838 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:37.829561 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:37.829478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:37.920189 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:37.920153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:38.616965 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:38.616932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:38.821162 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:38.821132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:38.923250 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:38.923165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:39.829564 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:39.829533 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:39.896390 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:39.896298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx56t" event={"ID":"13bf96a9-2334-45f2-b2f1-52bfc29af22d","Type":"ContainerStarted","Data":"43e44760c0e77db2919825dd6c55d22d63b74eefb1eb51487fc2a6a1cd34116e"} Jul 10 18:30:39.896390 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:39.896362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx56t" event={"ID":"13bf96a9-2334-45f2-b2f1-52bfc29af22d","Type":"ContainerStarted","Data":"65f4c76558330fcf5f94a06f2e498fddc7780f3cbe218f7370cf791d93881677"} Jul 10 18:30:40.118614 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:40.118569 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:40.218315 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:40.218227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:40.277377 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:40.277347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:41.351115 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.350986 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddbc69f69-59mcv"] Jul 10 18:30:41.351540 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:41.351241 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" podUID="6751ea7f-f5f6-4fac-8cde-f25fdc3354db" Jul 10 18:30:41.363894 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.363865 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-m2t7r"] Jul 10 18:30:41.369715 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.369689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:30:41.372514 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.372490 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:30:41.372632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.372522 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:30:41.372632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.372611 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vw5bf\"" Jul 10 18:30:41.379877 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.379855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-m2t7r"] Jul 10 18:30:41.403180 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.403134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:41.467258 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.467224 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cd7848d87-vqmf8"] Jul 10 18:30:41.470604 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.470580 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.473547 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.473518 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxxhv\" (UniqueName: \"kubernetes.io/projected/93c7a868-bc55-4782-a3f5-051b1075d396-kube-api-access-jxxhv\") pod \"downloads-68c9cbb497-m2t7r\" (UID: \"93c7a868-bc55-4782-a3f5-051b1075d396\") " pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:30:41.485770 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.485744 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cd7848d87-vqmf8"] Jul 10 18:30:41.497104 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.497075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:41.574253 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxxhv\" (UniqueName: \"kubernetes.io/projected/93c7a868-bc55-4782-a3f5-051b1075d396-kube-api-access-jxxhv\") pod \"downloads-68c9cbb497-m2t7r\" (UID: \"93c7a868-bc55-4782-a3f5-051b1075d396\") " pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:30:41.574450 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-installation-pull-secrets\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574450 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-trusted-ca\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574600 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-image-registry-private-configuration\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574600 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krdnq\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-kube-api-access-krdnq\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574600 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-registry-tls\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574600 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-registry-certificates\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574794 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-ca-trust-extracted\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.574794 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.574731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-bound-sa-token\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.582464 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.582419 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxxhv\" (UniqueName: \"kubernetes.io/projected/93c7a868-bc55-4782-a3f5-051b1075d396-kube-api-access-jxxhv\") pod \"downloads-68c9cbb497-m2t7r\" (UID: \"93c7a868-bc55-4782-a3f5-051b1075d396\") " pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:30:41.675374 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-bound-sa-token\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-installation-pull-secrets\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-trusted-ca\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-image-registry-private-configuration\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krdnq\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-kube-api-access-krdnq\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-registry-tls\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675826 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-registry-certificates\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.675882 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.675828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-ca-trust-extracted\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.676233 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.676189 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-ca-trust-extracted\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.676663 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.676612 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-trusted-ca\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.676950 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.676893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-registry-certificates\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.678367 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.678340 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-image-registry-private-configuration\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.678561 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.678546 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-registry-tls\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.678978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.678955 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-installation-pull-secrets\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.681743 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.681722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:30:41.687129 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.687082 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krdnq\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-kube-api-access-krdnq\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.687241 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.687136 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7528e3d-a4af-4263-a33e-a4d3e7dd8442-bound-sa-token\") pod \"image-registry-5cd7848d87-vqmf8\" (UID: \"a7528e3d-a4af-4263-a33e-a4d3e7dd8442\") " pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.783286 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.783254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6l98j\"" Jul 10 18:30:41.792285 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.792225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:41.903700 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.903669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:41.912406 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.912377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:41.979206 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979170 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-ca-trust-extracted\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979246 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-certificates\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979283 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-image-registry-private-configuration\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979348 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6pmb\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-kube-api-access-s6pmb\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979368 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-trusted-ca\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979643 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979408 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-bound-sa-token\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979643 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979570 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:30:41.979795 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979644 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-installation-pull-secrets\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:41.979795 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979669 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:30:41.979902 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979864 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:30:41.980004 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.979981 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-trusted-ca\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:41.980004 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.980006 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-ca-trust-extracted\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:41.980213 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.980021 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-certificates\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:41.982063 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.982036 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:30:41.982190 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.982130 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:30:41.982241 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.982180 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:30:41.982294 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:41.982271 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-kube-api-access-s6pmb" (OuterVolumeSpecName: "kube-api-access-s6pmb") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "kube-api-access-s6pmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:30:42.080648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.080574 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-installation-pull-secrets\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:42.080648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.080607 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-image-registry-private-configuration\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:42.080648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.080623 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6pmb\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-kube-api-access-s6pmb\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:42.080648 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.080637 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-bound-sa-token\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:42.184476 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.184420 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cd7848d87-vqmf8"] Jul 10 18:30:42.187445 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:42.187385 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7528e3d_a4af_4263_a33e_a4d3e7dd8442.slice/crio-c5afad25a0c0542e66786d8bb8ec1925c363d505f0cdafbe7e1b4c7a0c1aef87 WatchSource:0}: Error finding container c5afad25a0c0542e66786d8bb8ec1925c363d505f0cdafbe7e1b4c7a0c1aef87: Status 404 returned error can't find the container with id c5afad25a0c0542e66786d8bb8ec1925c363d505f0cdafbe7e1b4c7a0c1aef87 Jul 10 18:30:42.200073 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.200045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-m2t7r"] Jul 10 18:30:42.202940 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:42.202911 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c7a868_bc55_4782_a3f5_051b1075d396.slice/crio-00e165866b34948da8564c277e50252b3fca9ef08e788a4e9f6811875c9b1a6f WatchSource:0}: Error finding container 00e165866b34948da8564c277e50252b3fca9ef08e788a4e9f6811875c9b1a6f: Status 404 returned error can't find the container with id 00e165866b34948da8564c277e50252b3fca9ef08e788a4e9f6811875c9b1a6f Jul 10 18:30:42.378390 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.378355 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:42.429534 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.429494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:42.786602 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.786561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:42.788948 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.788924 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24e11806-feda-477a-bb30-4e2edded4542-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-z4znq\" (UID: \"24e11806-feda-477a-bb30-4e2edded4542\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:42.887266 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.887232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:42.887415 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.887286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:42.887415 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.887319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:42.887415 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.887364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:42.887983 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.887949 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28295818-cd5d-4af1-a94a-518ea8991c49-service-ca-bundle\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:42.889752 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.889723 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c15740a-984f-4a75-83b3-2b74c94297de-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jjltm\" (UID: \"1c15740a-984f-4a75-83b3-2b74c94297de\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:42.889848 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.889725 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28295818-cd5d-4af1-a94a-518ea8991c49-metrics-certs\") pod \"router-default-78bfb77584-jqn6f\" (UID: \"28295818-cd5d-4af1-a94a-518ea8991c49\") " pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:42.889848 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.889761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"image-registry-6ddbc69f69-59mcv\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:42.909205 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.909175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lx56t" event={"ID":"13bf96a9-2334-45f2-b2f1-52bfc29af22d","Type":"ContainerStarted","Data":"9e5e0e36c63151f70e476dba1ebcf44f016648723cfc068265527d0778c36881"} Jul 10 18:30:42.910289 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.910259 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-m2t7r" event={"ID":"93c7a868-bc55-4782-a3f5-051b1075d396","Type":"ContainerStarted","Data":"00e165866b34948da8564c277e50252b3fca9ef08e788a4e9f6811875c9b1a6f"} Jul 10 18:30:42.911499 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.911473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" event={"ID":"a7528e3d-a4af-4263-a33e-a4d3e7dd8442","Type":"ContainerStarted","Data":"23b0b1380ecc820ab2a858ad8da18fe2de199f83221d8a8884519dcab8a8bf2d"} Jul 10 18:30:42.911594 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.911516 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" event={"ID":"a7528e3d-a4af-4263-a33e-a4d3e7dd8442","Type":"ContainerStarted","Data":"c5afad25a0c0542e66786d8bb8ec1925c363d505f0cdafbe7e1b4c7a0c1aef87"} Jul 10 18:30:42.911594 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.911548 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:30:42.911594 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.911482 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddbc69f69-59mcv" Jul 10 18:30:42.926914 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.926855 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lx56t" podStartSLOduration=17.243175353 podStartE2EDuration="23.926843275s" totalImagesPullingTime="6.683667922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:42.924989768 +0000 UTC m=+84.517462000" watchObservedRunningTime="2026-07-10 18:30:42.926843275 +0000 UTC m=+84.519315482" Jul 10 18:30:42.951829 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.951783 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" podStartSLOduration=1.951768824 podStartE2EDuration="1.951768824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:42.951035899 +0000 UTC m=+84.543508118" watchObservedRunningTime="2026-07-10 18:30:42.951768824 +0000 UTC m=+84.544241031" Jul 10 18:30:42.962461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.962440 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5kprl\"" Jul 10 18:30:42.971295 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.971273 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" Jul 10 18:30:42.987791 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.987761 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") pod \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\" (UID: \"6751ea7f-f5f6-4fac-8cde-f25fdc3354db\") " Jul 10 18:30:42.989835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:42.989811 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6751ea7f-f5f6-4fac-8cde-f25fdc3354db" (UID: "6751ea7f-f5f6-4fac-8cde-f25fdc3354db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:30:43.088874 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.088843 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6751ea7f-f5f6-4fac-8cde-f25fdc3354db-registry-tls\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:30:43.091214 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.091165 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq"] Jul 10 18:30:43.093697 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:43.093669 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e11806_feda_477a_bb30_4e2edded4542.slice/crio-a82403eff75eeae134c5192fda61af2021059824ff708d735096fdf063a8aacc WatchSource:0}: Error finding container a82403eff75eeae134c5192fda61af2021059824ff708d735096fdf063a8aacc: Status 404 returned error can't find the container with id a82403eff75eeae134c5192fda61af2021059824ff708d735096fdf063a8aacc Jul 10 18:30:43.101499 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.101480 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4zqg5\"" Jul 10 18:30:43.107993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.107969 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c9fbn\"" Jul 10 18:30:43.109531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.109513 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:43.117049 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.117033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" Jul 10 18:30:43.244721 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.244692 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78bfb77584-jqn6f"] Jul 10 18:30:43.248267 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:43.248236 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28295818_cd5d_4af1_a94a_518ea8991c49.slice/crio-176c82152834a123cf2bc8b02ac573baacf1ce2e6fbad554f2d4f153266e3925 WatchSource:0}: Error finding container 176c82152834a123cf2bc8b02ac573baacf1ce2e6fbad554f2d4f153266e3925: Status 404 returned error can't find the container with id 176c82152834a123cf2bc8b02ac573baacf1ce2e6fbad554f2d4f153266e3925 Jul 10 18:30:43.248765 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.248744 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddbc69f69-59mcv"] Jul 10 18:30:43.251750 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.251733 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ddbc69f69-59mcv"] Jul 10 18:30:43.261827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.261806 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jjltm"] Jul 10 18:30:43.264532 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:43.264506 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c15740a_984f_4a75_83b3_2b74c94297de.slice/crio-5d92c506d755e9f46d8a657df047f2eee8ffef86a0355f4e497f814f49afe3f3 WatchSource:0}: Error finding container 5d92c506d755e9f46d8a657df047f2eee8ffef86a0355f4e497f814f49afe3f3: Status 404 returned error can't find the container with id 5d92c506d755e9f46d8a657df047f2eee8ffef86a0355f4e497f814f49afe3f3 Jul 10 18:30:43.463136 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.463089 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6751ea7f-f5f6-4fac-8cde-f25fdc3354db" path="/var/lib/kubelet/pods/6751ea7f-f5f6-4fac-8cde-f25fdc3354db/volumes" Jul 10 18:30:43.917624 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.917532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78bfb77584-jqn6f" event={"ID":"28295818-cd5d-4af1-a94a-518ea8991c49","Type":"ContainerStarted","Data":"f4e824c48ad6ba64c3e365913ea4363ac012a1765ddca81f23abd0890b1731d3"} Jul 10 18:30:43.917801 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.917630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78bfb77584-jqn6f" event={"ID":"28295818-cd5d-4af1-a94a-518ea8991c49","Type":"ContainerStarted","Data":"176c82152834a123cf2bc8b02ac573baacf1ce2e6fbad554f2d4f153266e3925"} Jul 10 18:30:43.919043 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.919008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" event={"ID":"24e11806-feda-477a-bb30-4e2edded4542","Type":"ContainerStarted","Data":"a82403eff75eeae134c5192fda61af2021059824ff708d735096fdf063a8aacc"} Jul 10 18:30:43.920500 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.920465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" event={"ID":"1c15740a-984f-4a75-83b3-2b74c94297de","Type":"ContainerStarted","Data":"5d92c506d755e9f46d8a657df047f2eee8ffef86a0355f4e497f814f49afe3f3"} Jul 10 18:30:43.936961 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:43.936910 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78bfb77584-jqn6f" podStartSLOduration=33.936890358 podStartE2EDuration="33.936890358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:43.935653742 +0000 UTC m=+85.528125997" watchObservedRunningTime="2026-07-10 18:30:43.936890358 +0000 UTC m=+85.529362566" Jul 10 18:30:44.110046 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.109963 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:44.113068 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.113029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:44.829030 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.828993 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:44.882633 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.882591 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:44.927130 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.927077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" event={"ID":"1c15740a-984f-4a75-83b3-2b74c94297de","Type":"ContainerStarted","Data":"d3e0dc3758f26b4e4f19d64fbed2befcbc0ba2d5d191bd1fa699a47f1be1afcf"} Jul 10 18:30:44.927622 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.927600 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:44.928981 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.928959 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78bfb77584-jqn6f" Jul 10 18:30:44.941846 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:44.941801 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-jjltm" podStartSLOduration=33.813534261 podStartE2EDuration="34.941783851s" totalImagesPullingTime="1.12824959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:44.941302295 +0000 UTC m=+86.533774505" watchObservedRunningTime="2026-07-10 18:30:44.941783851 +0000 UTC m=+86.534256061" Jul 10 18:30:45.074635 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.074560 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:45.131240 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.131163 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:45.494973 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.494926 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:45.596142 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.596115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:45.645897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.645864 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl"] Jul 10 18:30:45.648852 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.648824 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:45.651533 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.651506 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 18:30:45.651533 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.651520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5fk4x\"" Jul 10 18:30:45.655531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.655473 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl"] Jul 10 18:30:45.662056 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.662003 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:45.714254 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.714220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861e7816-c6ac-494d-9a2a-b4cc67a739e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vzshl\" (UID: \"861e7816-c6ac-494d-9a2a-b4cc67a739e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:45.815555 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.815474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861e7816-c6ac-494d-9a2a-b4cc67a739e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vzshl\" (UID: \"861e7816-c6ac-494d-9a2a-b4cc67a739e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:45.815727 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:45.815625 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 10 18:30:45.815727 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:45.815694 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/861e7816-c6ac-494d-9a2a-b4cc67a739e9-tls-certificates podName:861e7816-c6ac-494d-9a2a-b4cc67a739e9 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:46.315675042 +0000 UTC m=+87.908147237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/861e7816-c6ac-494d-9a2a-b4cc67a739e9-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-vzshl" (UID: "861e7816-c6ac-494d-9a2a-b4cc67a739e9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 10 18:30:45.866853 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.866821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:45.932404 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.932370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" event={"ID":"24e11806-feda-477a-bb30-4e2edded4542","Type":"ContainerStarted","Data":"56670b7fcc3bc8870cc46817ecb6bab6e843175bf599c101d7b6c4f23bd35d46"} Jul 10 18:30:45.947332 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:45.947280 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-z4znq" podStartSLOduration=33.899208506 podStartE2EDuration="35.947261949s" totalImagesPullingTime="2.048053443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:45.947139353 +0000 UTC m=+87.539611562" watchObservedRunningTime="2026-07-10 18:30:45.947261949 +0000 UTC m=+87.539734159" Jul 10 18:30:46.233975 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.233938 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-577c4f9f97-8mlz7"] Jul 10 18:30:46.236067 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.236044 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.238403 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.238385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:30:46.238712 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.238694 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:30:46.238809 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.238707 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:30:46.238809 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.238764 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:30:46.239125 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.239101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9kk5z\"" Jul 10 18:30:46.239125 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.239121 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:30:46.253195 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.253172 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577c4f9f97-8mlz7"] Jul 10 18:30:46.321062 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msf7l\" (UniqueName: \"kubernetes.io/projected/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-kube-api-access-msf7l\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.321234 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-service-ca\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.321234 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861e7816-c6ac-494d-9a2a-b4cc67a739e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vzshl\" (UID: \"861e7816-c6ac-494d-9a2a-b4cc67a739e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:46.321336 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-oauth-config\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.321382 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-serving-cert\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.321382 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-config\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.321496 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.321394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-oauth-serving-cert\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.324065 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.324042 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861e7816-c6ac-494d-9a2a-b4cc67a739e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vzshl\" (UID: \"861e7816-c6ac-494d-9a2a-b4cc67a739e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:46.422486 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.422425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msf7l\" (UniqueName: \"kubernetes.io/projected/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-kube-api-access-msf7l\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.422662 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.422506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-service-ca\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.422662 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.422564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-oauth-config\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.422802 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.422771 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-serving-cert\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.422863 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.422810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-config\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.422863 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.422843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-oauth-serving-cert\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.423385 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.423344 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-service-ca\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.423571 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.423526 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-oauth-serving-cert\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.423655 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.423624 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-config\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.425626 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.425603 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-oauth-config\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.426123 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.426098 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-serving-cert\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.435359 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.435334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msf7l\" (UniqueName: \"kubernetes.io/projected/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-kube-api-access-msf7l\") pod \"console-577c4f9f97-8mlz7\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.545671 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.545558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:46.562465 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.562414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:46.705537 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.705466 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577c4f9f97-8mlz7"] Jul 10 18:30:46.708639 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:46.708608 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e90f6f9_e77c_4ab6_b6bc_754833a7a0a8.slice/crio-315f490fc4bb110452180ac83eb3702563dfad26527befd973af6f5abf458aac WatchSource:0}: Error finding container 315f490fc4bb110452180ac83eb3702563dfad26527befd973af6f5abf458aac: Status 404 returned error can't find the container with id 315f490fc4bb110452180ac83eb3702563dfad26527befd973af6f5abf458aac Jul 10 18:30:46.725074 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.725047 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl"] Jul 10 18:30:46.728075 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:30:46.728049 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861e7816_c6ac_494d_9a2a_b4cc67a739e9.slice/crio-5edf503069501f418cefe6b36c1b15928e17bd36ffd31cffe4dc6779ead0d95b WatchSource:0}: Error finding container 5edf503069501f418cefe6b36c1b15928e17bd36ffd31cffe4dc6779ead0d95b: Status 404 returned error can't find the container with id 5edf503069501f418cefe6b36c1b15928e17bd36ffd31cffe4dc6779ead0d95b Jul 10 18:30:46.937521 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.937421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" event={"ID":"861e7816-c6ac-494d-9a2a-b4cc67a739e9","Type":"ContainerStarted","Data":"5edf503069501f418cefe6b36c1b15928e17bd36ffd31cffe4dc6779ead0d95b"} Jul 10 18:30:46.938892 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:46.938859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f9f97-8mlz7" event={"ID":"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8","Type":"ContainerStarted","Data":"315f490fc4bb110452180ac83eb3702563dfad26527befd973af6f5abf458aac"} Jul 10 18:30:47.088133 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:47.088092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:47.155398 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:47.155366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:47.429257 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:47.429207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:47.522190 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:47.522153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:48.951935 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:48.951889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" event={"ID":"861e7816-c6ac-494d-9a2a-b4cc67a739e9","Type":"ContainerStarted","Data":"89bdfe31c386d9b4cc4aaadac3ae152681e2d22f5f4c67b4467a02ccfb62ad70"} Jul 10 18:30:48.952495 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:48.952327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:48.957918 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:48.957893 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" Jul 10 18:30:48.969247 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:48.969194 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vzshl" podStartSLOduration=2.562416806 podStartE2EDuration="3.969174673s" totalImagesPullingTime="1.406757867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:48.967676835 +0000 UTC m=+90.560149046" watchObservedRunningTime="2026-07-10 18:30:48.969174673 +0000 UTC m=+90.561646883" Jul 10 18:30:49.672776 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:49.672738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:49.757009 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:49.756968 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:50.962702 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:50.962596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f9f97-8mlz7" event={"ID":"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8","Type":"ContainerStarted","Data":"06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec"} Jul 10 18:30:50.978926 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:50.978697 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-577c4f9f97-8mlz7" podStartSLOduration=1.049349316 podStartE2EDuration="4.978680215s" totalImagesPullingTime="3.929330899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:50.97867754 +0000 UTC m=+92.571149772" watchObservedRunningTime="2026-07-10 18:30:50.978680215 +0000 UTC m=+92.571152424" Jul 10 18:30:51.239067 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:51.239012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:55.511173 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:55.511132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:55.634299 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:55.634262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:56.546009 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:56.545969 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:56.546519 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:56.546043 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:30:56.547379 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:56.547317 2567 patch_prober.go:28] interesting pod/console-577c4f9f97-8mlz7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jul 10 18:30:56.547531 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:56.547378 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-577c4f9f97-8mlz7" podUID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jul 10 18:30:56.826932 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:56.826841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:56.828557 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:56.828531 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xp8x9" Jul 10 18:30:57.035578 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.035492 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.096732 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.096665 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcvkb"] Jul 10 18:30:57.100645 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.100367 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.103852 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.103155 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 18:30:57.103852 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.103380 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 18:30:57.103852 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.103642 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 18:30:57.104205 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.104184 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 18:30:57.104480 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.104460 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cvltk\"" Jul 10 18:30:57.128468 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.128415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.200154 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.200044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.217734 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.217897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9nxb\" (UniqueName: \"kubernetes.io/projected/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-kube-api-access-j9nxb\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.217897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.217897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-wtmp\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.217897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-sys\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.217897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-root\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.218139 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-textfile\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.218139 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.217953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-metrics-client-ca\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.218139 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.218015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-tls\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.303353 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.302090 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-root\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-textfile\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-metrics-client-ca\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-tls\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9nxb\" (UniqueName: \"kubernetes.io/projected/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-kube-api-access-j9nxb\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-wtmp\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.318978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-sys\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.319053 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-sys\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.319097 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-root\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.319402 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-textfile\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.319894 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-metrics-client-ca\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:57.319988 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:30:57.320055 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-tls podName:2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a nodeName:}" failed. No retries permitted until 2026-07-10 18:30:57.820035517 +0000 UTC m=+99.412507709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-tls") pod "node-exporter-kcvkb" (UID: "2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a") : secret "node-exporter-tls" not found Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.320835 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.321448 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.321237 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-wtmp\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.323500 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.323417 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.330784 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.330732 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9nxb\" (UniqueName: \"kubernetes.io/projected/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-kube-api-access-j9nxb\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.405147 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.404982 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.500074 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.500025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.559837 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.559788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:57.823249 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.823211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-tls\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.826175 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.826144 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a-node-exporter-tls\") pod \"node-exporter-kcvkb\" (UID: \"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a\") " pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:57.867659 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:57.867620 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:58.015104 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.015039 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcvkb" Jul 10 18:30:58.612471 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.612405 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:58.631710 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.631677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:30:58.635046 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.635024 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4efbf632-c810-4b02-83e6-44a901c22bb2-metrics-tls\") pod \"dns-default-wq99l\" (UID: \"4efbf632-c810-4b02-83e6-44a901c22bb2\") " pod="openshift-dns/dns-default-wq99l" Jul 10 18:30:58.651673 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.651641 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf98r\"" Jul 10 18:30:58.659834 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.659803 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq99l" Jul 10 18:30:58.668170 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:58.668143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:59.107503 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:59.107466 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:59.205790 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:59.205752 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:30:59.997216 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:30:59.997178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:00.074242 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:00.074207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:00.141735 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:00.141699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:00.457825 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:00.457730 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:00.559796 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:00.559759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:01.799224 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:01.799187 2567 patch_prober.go:28] interesting pod/image-registry-5cd7848d87-vqmf8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 18:31:01.799685 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:01.799245 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" podUID="a7528e3d-a4af-4263-a33e-a4d3e7dd8442" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:31:01.841669 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:01.841631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:01.938544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:01.938506 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:02.039695 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:02.039649 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577c4f9f97-8mlz7"] Jul 10 18:31:02.040661 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:02.040629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:02.527275 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:02.527242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:02.596504 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:02.596466 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:02.657417 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:02.657375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:03.047162 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:03.047126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:03.147253 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:03.147221 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:03.286504 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:03.286464 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:03.424623 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:31:03.424590 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0f4e91_1bc3_4aaa_84c2_5ad24e88786a.slice/crio-672f9cf87452302d8be49f6fe51e1effbab2efcca35f39826ee56900502b1bde WatchSource:0}: Error finding container 672f9cf87452302d8be49f6fe51e1effbab2efcca35f39826ee56900502b1bde: Status 404 returned error can't find the container with id 672f9cf87452302d8be49f6fe51e1effbab2efcca35f39826ee56900502b1bde Jul 10 18:31:03.550544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:03.550523 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wq99l"] Jul 10 18:31:03.553324 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:31:03.553299 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efbf632_c810_4b02_83e6_44a901c22bb2.slice/crio-4e5521aa6a7914fe8a2f577f4c83eb171fb497c3c069dede113450081a10c7e8 WatchSource:0}: Error finding container 4e5521aa6a7914fe8a2f577f4c83eb171fb497c3c069dede113450081a10c7e8: Status 404 returned error can't find the container with id 4e5521aa6a7914fe8a2f577f4c83eb171fb497c3c069dede113450081a10c7e8 Jul 10 18:31:03.925505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:03.925469 2567 patch_prober.go:28] interesting pod/image-registry-5cd7848d87-vqmf8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 18:31:03.925768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:03.925530 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" podUID="a7528e3d-a4af-4263-a33e-a4d3e7dd8442" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:31:04.022577 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:04.022539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-m2t7r" event={"ID":"93c7a868-bc55-4782-a3f5-051b1075d396","Type":"ContainerStarted","Data":"e5ce89cd4eb74fe8479caa37e3bfb637baefb988b50e9c364a34e88acf1a5084"} Jul 10 18:31:04.022956 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:04.022839 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:31:04.024279 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:04.024249 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcvkb" event={"ID":"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a","Type":"ContainerStarted","Data":"672f9cf87452302d8be49f6fe51e1effbab2efcca35f39826ee56900502b1bde"} Jul 10 18:31:04.025511 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:04.025486 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq99l" event={"ID":"4efbf632-c810-4b02-83e6-44a901c22bb2","Type":"ContainerStarted","Data":"4e5521aa6a7914fe8a2f577f4c83eb171fb497c3c069dede113450081a10c7e8"} Jul 10 18:31:04.039757 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:04.039706 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-m2t7r" podStartSLOduration=1.701427759 podStartE2EDuration="23.039688808s" totalImagesPullingTime="21.338261049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:04.039133772 +0000 UTC m=+105.631605980" watchObservedRunningTime="2026-07-10 18:31:04.039688808 +0000 UTC m=+105.632161017" Jul 10 18:31:04.040858 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:04.040832 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-m2t7r" Jul 10 18:31:06.037334 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:06.037260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcvkb" event={"ID":"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a","Type":"ContainerStarted","Data":"7b429fee6d4738701b07847bd3d8436ea86729bf6d7fa7a469e92b6f2fb1bb6f"} Jul 10 18:31:06.437672 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:06.437640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:07.043266 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.043224 2567 generic.go:356] "Generic (PLEG): container finished" podID="2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a" containerID="7b429fee6d4738701b07847bd3d8436ea86729bf6d7fa7a469e92b6f2fb1bb6f" exitCode=0 Jul 10 18:31:07.043843 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.043313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcvkb" event={"ID":"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a","Type":"ContainerDied","Data":"7b429fee6d4738701b07847bd3d8436ea86729bf6d7fa7a469e92b6f2fb1bb6f"} Jul 10 18:31:07.045618 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.045580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq99l" event={"ID":"4efbf632-c810-4b02-83e6-44a901c22bb2","Type":"ContainerStarted","Data":"6c62316616625ee2445bb717188826cf038862dfad1824a81808b01dbcf09b31"} Jul 10 18:31:07.045746 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.045642 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq99l" event={"ID":"4efbf632-c810-4b02-83e6-44a901c22bb2","Type":"ContainerStarted","Data":"721a30fff51ca96e8cf7c3ba93164ee4baa9dfe9f3dbd5b569174464df4d3e34"} Jul 10 18:31:07.045746 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.045710 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wq99l" Jul 10 18:31:07.077341 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.077297 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wq99l" podStartSLOduration=70.365072645 podStartE2EDuration="1m13.077282355s" totalImagesPullingTime="2.71220971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:07.077106417 +0000 UTC m=+108.669578626" watchObservedRunningTime="2026-07-10 18:31:07.077282355 +0000 UTC m=+108.669754563" Jul 10 18:31:07.676479 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.676389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:07.742220 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:07.742189 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:08.053007 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:08.052967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcvkb" event={"ID":"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a","Type":"ContainerStarted","Data":"dc23adbba0c094f03647c42a549a4a6cfa28f0f6bdeaf859706cb1976fbbf3d7"} Jul 10 18:31:08.053489 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:08.053039 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcvkb" event={"ID":"2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a","Type":"ContainerStarted","Data":"a6144f1fcb050862cd58b295b4744a1131071759eb86a77a10a52909f3b674d7"} Jul 10 18:31:08.073958 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:08.073906 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcvkb" podStartSLOduration=8.595201344 podStartE2EDuration="11.073887269s" totalImagesPullingTime="2.413008231s" totalInitContainerRuntime="65.677694ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:08.07159704 +0000 UTC m=+109.664069273" watchObservedRunningTime="2026-07-10 18:31:08.073887269 +0000 UTC m=+109.666359477" Jul 10 18:31:11.797449 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:11.797392 2567 patch_prober.go:28] interesting pod/image-registry-5cd7848d87-vqmf8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 18:31:11.797876 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:11.797480 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" podUID="a7528e3d-a4af-4263-a33e-a4d3e7dd8442" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:31:13.385312 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:13.385275 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:13.485789 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:13.485753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:13.821126 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:13.821090 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:13.924188 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:13.924152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:13.925129 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:13.925106 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cd7848d87-vqmf8" Jul 10 18:31:14.000737 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:14.000700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:14.074678 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:14.074594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:14.175996 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:14.175961 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:14.277257 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:14.277224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:14.520477 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:14.520422 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:14.591112 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:14.591078 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:17.054839 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:17.054811 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wq99l" Jul 10 18:31:19.877512 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:19.877478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:19.998268 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:19.998235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:20.100987 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:20.100943 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:22.965278 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:22.965238 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:23.021869 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:23.021816 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:25.143772 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:25.143744 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:25.244407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:25.244364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:25.478548 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:25.478511 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:25.576850 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:25.576818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:25.641618 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:25.641585 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:26.177677 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:26.177645 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:27.063114 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.063073 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-577c4f9f97-8mlz7" podUID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" containerName="console" containerID="cri-o://06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec" gracePeriod=15 Jul 10 18:31:27.344020 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.343951 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:31:27.389145 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389112 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msf7l\" (UniqueName: \"kubernetes.io/projected/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-kube-api-access-msf7l\") pod \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " Jul 10 18:31:27.389145 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389143 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-oauth-config\") pod \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " Jul 10 18:31:27.389368 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389174 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-oauth-serving-cert\") pod \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " Jul 10 18:31:27.389368 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389207 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-service-ca\") pod \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " Jul 10 18:31:27.389368 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389242 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-serving-cert\") pod \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " Jul 10 18:31:27.389368 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389260 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-config\") pod \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\" (UID: \"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8\") " Jul 10 18:31:27.389711 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389682 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" (UID: "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:27.389711 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389697 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" (UID: "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:27.389889 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.389760 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-config" (OuterVolumeSpecName: "console-config") pod "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" (UID: "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:27.391540 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.391507 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" (UID: "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:31:27.391640 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.391610 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" (UID: "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:31:27.391680 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.391634 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-kube-api-access-msf7l" (OuterVolumeSpecName: "kube-api-access-msf7l") pod "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" (UID: "4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8"). InnerVolumeSpecName "kube-api-access-msf7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:27.490306 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.490270 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msf7l\" (UniqueName: \"kubernetes.io/projected/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-kube-api-access-msf7l\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:31:27.490306 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.490304 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-oauth-config\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:31:27.490562 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.490319 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-oauth-serving-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:31:27.490562 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.490333 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-service-ca\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:31:27.490562 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.490347 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-serving-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:31:27.490562 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:27.490361 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8-console-config\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:31:28.135142 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.135108 2567 generic.go:356] "Generic (PLEG): container finished" podID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" containerID="06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec" exitCode=0 Jul 10 18:31:28.135344 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.135153 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f9f97-8mlz7" Jul 10 18:31:28.135344 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.135198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f9f97-8mlz7" event={"ID":"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8","Type":"ContainerDied","Data":"06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec"} Jul 10 18:31:28.135344 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.135260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f9f97-8mlz7" event={"ID":"4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8","Type":"ContainerDied","Data":"315f490fc4bb110452180ac83eb3702563dfad26527befd973af6f5abf458aac"} Jul 10 18:31:28.135344 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.135288 2567 scope.go:117] "RemoveContainer" containerID="06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec" Jul 10 18:31:28.148178 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.148158 2567 scope.go:117] "RemoveContainer" containerID="06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec" Jul 10 18:31:28.148473 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:31:28.148447 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec\": container with ID starting with 06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec not found: ID does not exist" containerID="06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec" Jul 10 18:31:28.148543 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.148480 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec"} err="failed to get container status \"06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec\": rpc error: code = NotFound desc = could not find container \"06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec\": container with ID starting with 06458f0421d5bbaf55cd5967716f558c17064d5e7010fd70c174ee551975a9ec not found: ID does not exist" Jul 10 18:31:28.151650 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.151627 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577c4f9f97-8mlz7"] Jul 10 18:31:28.155033 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:28.155013 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-577c4f9f97-8mlz7"] Jul 10 18:31:29.462672 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:29.462644 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" path="/var/lib/kubelet/pods/4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8/volumes" Jul 10 18:31:29.508400 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:29.508369 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:31:29.510817 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:29.510783 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1ec905-11fb-476d-90ee-b30ba0841965-metrics-certs\") pod \"network-metrics-daemon-xjl5g\" (UID: \"7e1ec905-11fb-476d-90ee-b30ba0841965\") " pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:31:29.669678 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:29.669643 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hhh94\"" Jul 10 18:31:29.676971 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:29.676953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjl5g" Jul 10 18:31:29.836768 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:29.836745 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xjl5g"] Jul 10 18:31:29.838876 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:31:29.838848 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1ec905_11fb_476d_90ee_b30ba0841965.slice/crio-3718f4302c94552d54361613ab08737dc750acb6857649c9508e3a5fec842a1d WatchSource:0}: Error finding container 3718f4302c94552d54361613ab08737dc750acb6857649c9508e3a5fec842a1d: Status 404 returned error can't find the container with id 3718f4302c94552d54361613ab08737dc750acb6857649c9508e3a5fec842a1d Jul 10 18:31:30.144761 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:30.144725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjl5g" event={"ID":"7e1ec905-11fb-476d-90ee-b30ba0841965","Type":"ContainerStarted","Data":"3718f4302c94552d54361613ab08737dc750acb6857649c9508e3a5fec842a1d"} Jul 10 18:31:32.156474 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:32.156421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjl5g" event={"ID":"7e1ec905-11fb-476d-90ee-b30ba0841965","Type":"ContainerStarted","Data":"78b07767f0851abc0574eda27c5f810e8ac5615630b0c59d33f4d336a2706a34"} Jul 10 18:31:32.156935 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:32.156494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjl5g" event={"ID":"7e1ec905-11fb-476d-90ee-b30ba0841965","Type":"ContainerStarted","Data":"07afc45239f97ffbaf788a55d6b0438dd9f602662093925ac36a1711b54d0967"} Jul 10 18:31:32.173883 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:32.173838 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xjl5g" podStartSLOduration=130.692594894 podStartE2EDuration="2m12.173823537s" totalImagesPullingTime="1.481228643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:32.172568948 +0000 UTC m=+133.765041156" watchObservedRunningTime="2026-07-10 18:31:32.173823537 +0000 UTC m=+133.766295744" Jul 10 18:31:32.265017 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:32.264969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:32.325463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:32.325396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:35.484619 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:35.484587 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:39.184983 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:39.184897 2567 generic.go:356] "Generic (PLEG): container finished" podID="e0c1fa28-c2f5-46f7-a69f-6d14b47dde88" containerID="01feb98fefe76dba68a44fbccbf6e48a3cee399d0843ae5eabf5d4610d44c09d" exitCode=0 Jul 10 18:31:39.184983 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:39.184969 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" event={"ID":"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88","Type":"ContainerDied","Data":"01feb98fefe76dba68a44fbccbf6e48a3cee399d0843ae5eabf5d4610d44c09d"} Jul 10 18:31:39.185376 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:39.185297 2567 scope.go:117] "RemoveContainer" containerID="01feb98fefe76dba68a44fbccbf6e48a3cee399d0843ae5eabf5d4610d44c09d" Jul 10 18:31:40.118681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:40.118645 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:40.175922 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:40.175893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:31:40.190866 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:40.190839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fl9nz" event={"ID":"e0c1fa28-c2f5-46f7-a69f-6d14b47dde88","Type":"ContainerStarted","Data":"1fd56e70ba4d27167318fec60a708249c75daaa7abf1ccc3667eab57f4be0a49"} Jul 10 18:31:42.188424 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:42.188389 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-z4znq_24e11806-feda-477a-bb30-4e2edded4542/cluster-monitoring-operator/0.log" Jul 10 18:31:43.387005 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:43.386978 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcvkb_2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a/init-textfile/0.log" Jul 10 18:31:43.587218 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:43.587189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcvkb_2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a/node-exporter/0.log" Jul 10 18:31:43.787570 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:43.787545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcvkb_2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a/kube-rbac-proxy/0.log" Jul 10 18:31:44.207823 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:44.207787 2567 generic.go:356] "Generic (PLEG): container finished" podID="fdfb69da-cc9b-4141-9feb-d6b1459d7b92" containerID="1196a978e2284884665e4bbc43fc11dc9b71697f2a309c9f0f960d737581f8a5" exitCode=0 Jul 10 18:31:44.207989 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:44.207838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" event={"ID":"fdfb69da-cc9b-4141-9feb-d6b1459d7b92","Type":"ContainerDied","Data":"1196a978e2284884665e4bbc43fc11dc9b71697f2a309c9f0f960d737581f8a5"} Jul 10 18:31:44.208176 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:44.208162 2567 scope.go:117] "RemoveContainer" containerID="1196a978e2284884665e4bbc43fc11dc9b71697f2a309c9f0f960d737581f8a5" Jul 10 18:31:45.212797 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:45.212765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8hkxs" event={"ID":"fdfb69da-cc9b-4141-9feb-d6b1459d7b92","Type":"ContainerStarted","Data":"0ac93d5de957f49456a910d25e7eab52f4fada4d02ff83905e6200d973b19535"} Jul 10 18:31:47.587694 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:47.587651 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-vzshl_861e7816-c6ac-494d-9a2a-b4cc67a739e9/prometheus-operator-admission-webhook/0.log" Jul 10 18:31:49.587818 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:49.587738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-jjltm_1c15740a-984f-4a75-83b3-2b74c94297de/networking-console-plugin/0.log" Jul 10 18:31:49.788110 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:49.788081 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:31:49.988441 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:49.988410 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/2.log" Jul 10 18:31:50.231439 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:50.231392 2567 generic.go:356] "Generic (PLEG): container finished" podID="1b68f1d0-1ec5-46fc-98e8-e6af46e24618" containerID="33ac3c077ad543c19e20dab442e85856db99de4829f6ce4ef4dfa31070206c48" exitCode=0 Jul 10 18:31:50.231603 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:50.231468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" event={"ID":"1b68f1d0-1ec5-46fc-98e8-e6af46e24618","Type":"ContainerDied","Data":"33ac3c077ad543c19e20dab442e85856db99de4829f6ce4ef4dfa31070206c48"} Jul 10 18:31:50.231832 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:50.231815 2567 scope.go:117] "RemoveContainer" containerID="33ac3c077ad543c19e20dab442e85856db99de4829f6ce4ef4dfa31070206c48" Jul 10 18:31:50.589124 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:50.589017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-m2t7r_93c7a868-bc55-4782-a3f5-051b1075d396/download-server/0.log" Jul 10 18:31:50.788091 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:50.788059 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bfb77584-jqn6f_28295818-cd5d-4af1-a94a-518ea8991c49/router/0.log" Jul 10 18:31:51.237494 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:51.237459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2fdtp" event={"ID":"1b68f1d0-1ec5-46fc-98e8-e6af46e24618","Type":"ContainerStarted","Data":"7ee899f3868ba1070cbe993b2e24892f9bbc725bc77f6ea5a3183c697ddb90d5"} Jul 10 18:31:51.388099 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:31:51.388073 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrmhh_18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f/serve-healthcheck-canary/0.log" Jul 10 18:32:13.151987 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:13.151887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:13.211377 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:13.211341 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:19.666266 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.666231 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d4fbb4849-tw5wq"] Jul 10 18:32:19.667529 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.667503 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" containerName="console" Jul 10 18:32:19.667680 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.667668 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" containerName="console" Jul 10 18:32:19.667858 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.667846 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e90f6f9-e77c-4ab6-b6bc-754833a7a0a8" containerName="console" Jul 10 18:32:19.668898 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.666846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:19.670932 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.670915 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.673702 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.673681 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9kk5z\"" Jul 10 18:32:19.673905 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.673880 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:32:19.674728 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.674710 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:32:19.675475 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.675222 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:32:19.675604 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.675511 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:32:19.676091 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.676072 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:32:19.679023 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.679004 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4fbb4849-tw5wq"] Jul 10 18:32:19.681075 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.680557 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 18:32:19.710251 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-service-ca\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.710407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-config\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.710407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-oauth-config\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.710407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-serving-cert\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.710407 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-trusted-ca-bundle\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.710675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-oauth-serving-cert\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.710675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.710487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt46b\" (UniqueName: \"kubernetes.io/projected/d0d35600-81b5-4249-8f91-ec1554ee9cd6-kube-api-access-lt46b\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.733402 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.733377 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:19.811477 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-service-ca\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.811660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-config\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.811660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-oauth-config\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.811660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-serving-cert\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.811660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811558 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-trusted-ca-bundle\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.811660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-oauth-serving-cert\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.811660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.811598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt46b\" (UniqueName: \"kubernetes.io/projected/d0d35600-81b5-4249-8f91-ec1554ee9cd6-kube-api-access-lt46b\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.812315 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.812290 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-config\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.812456 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.812310 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-oauth-serving-cert\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.812456 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.812337 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-service-ca\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.812549 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.812527 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-trusted-ca-bundle\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.813961 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.813935 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-oauth-config\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.814072 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.814053 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-serving-cert\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.819749 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.819725 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt46b\" (UniqueName: \"kubernetes.io/projected/d0d35600-81b5-4249-8f91-ec1554ee9cd6-kube-api-access-lt46b\") pod \"console-6d4fbb4849-tw5wq\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:19.984170 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:19.984141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:20.112498 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.112468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4fbb4849-tw5wq"] Jul 10 18:32:20.244937 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.244812 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:20.344788 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.344756 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:20.351193 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.351166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fbb4849-tw5wq" event={"ID":"d0d35600-81b5-4249-8f91-ec1554ee9cd6","Type":"ContainerStarted","Data":"e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340"} Jul 10 18:32:20.351314 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.351210 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fbb4849-tw5wq" event={"ID":"d0d35600-81b5-4249-8f91-ec1554ee9cd6","Type":"ContainerStarted","Data":"bd415ec4c81b928ae834f62ee7beba685b7b8ba6e79de2d662850cc5eec56624"} Jul 10 18:32:20.367337 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.367281 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d4fbb4849-tw5wq" podStartSLOduration=1.3672619670000001 podStartE2EDuration="1.367261967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:20.367006843 +0000 UTC m=+181.959479051" watchObservedRunningTime="2026-07-10 18:32:20.367261967 +0000 UTC m=+181.959734176" Jul 10 18:32:20.445689 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.445657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:20.502211 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:20.502126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:21.248595 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:21.248542 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:21.306105 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:21.306062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:25.100918 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:25.100876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:25.154940 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:25.154906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:29.984518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:29.984470 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:29.984518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:29.984536 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:29.989301 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:29.989269 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:30.395494 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:30.395409 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:32:30.540967 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:30.540928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:30.591819 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:30.591786 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:30.650992 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:30.650914 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:32.241632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:32.241598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:32.343178 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:32.343134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:32.400079 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:32.400027 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:40.122740 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:40.122699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:32:40.185544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:32:40.185508 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:33:09.945068 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:33:09.945033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:33:10.008604 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:33:10.008574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:33:13.252222 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:33:13.252185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:33:59.961529 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:33:59.961499 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:34:18.850035 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:34:18.850007 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:34:18.859078 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:34:18.859053 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:34:18.861827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:34:18.861801 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:34:18.862047 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:34:18.862033 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 18:34:18.870155 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:34:18.870134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:35:10.723569 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:10.723508 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:11.962572 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:11.962538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:12.480350 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:12.480316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:12.581658 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:12.581628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:25.120349 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:25.120315 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:25.221388 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:25.221353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:52.958082 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:52.958026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:35:53.056966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:35:53.056919 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:09.758052 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.758013 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85c48ff4bc-vlb6j"] Jul 10 18:36:09.760733 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.760712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.771412 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.771385 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85c48ff4bc-vlb6j"] Jul 10 18:36:09.823855 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.823808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:09.844107 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-serving-cert\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.844107 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-service-ca\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.844304 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-oauth-serving-cert\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.844304 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-config\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.844304 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhvsz\" (UniqueName: \"kubernetes.io/projected/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-kube-api-access-xhvsz\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.844304 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-oauth-config\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.844480 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.844319 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-trusted-ca-bundle\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.924041 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.924000 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:09.945173 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhvsz\" (UniqueName: \"kubernetes.io/projected/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-kube-api-access-xhvsz\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.945315 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-oauth-config\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.945315 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-trusted-ca-bundle\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.945315 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945255 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-serving-cert\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.945493 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-service-ca\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.945572 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-oauth-serving-cert\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.945616 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.945594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-config\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.946190 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.946168 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-service-ca\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.946327 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.946271 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-config\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.946408 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.946334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-trusted-ca-bundle\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.946496 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.946413 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-oauth-serving-cert\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.947916 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.947897 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-oauth-config\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.948009 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.947951 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-console-serving-cert\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:09.953092 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:09.953071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhvsz\" (UniqueName: \"kubernetes.io/projected/ec2e6c0b-5c18-4aa5-889b-49eec6896ede-kube-api-access-xhvsz\") pod \"console-85c48ff4bc-vlb6j\" (UID: \"ec2e6c0b-5c18-4aa5-889b-49eec6896ede\") " pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:10.072184 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:10.072107 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:10.201811 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:10.201741 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85c48ff4bc-vlb6j"] Jul 10 18:36:10.220348 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:10.220322 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85c48ff4bc-vlb6j" event={"ID":"ec2e6c0b-5c18-4aa5-889b-49eec6896ede","Type":"ContainerStarted","Data":"ff46d59012fdb9842b43de85d5f4f5a5debd4115fed41d34e0086cf0352fbdb9"} Jul 10 18:36:11.226145 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:11.226110 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85c48ff4bc-vlb6j" event={"ID":"ec2e6c0b-5c18-4aa5-889b-49eec6896ede","Type":"ContainerStarted","Data":"983db4d6924336b8fb03b603d99fb9a3da732ddf1fc5c66994f1fb4063037094"} Jul 10 18:36:11.243062 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:11.243016 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85c48ff4bc-vlb6j" podStartSLOduration=2.243002599 podStartE2EDuration="2.243002599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:11.242875369 +0000 UTC m=+412.835347576" watchObservedRunningTime="2026-07-10 18:36:11.243002599 +0000 UTC m=+412.835474811" Jul 10 18:36:18.225152 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:18.225120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:19.106155 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:19.106117 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:20.073222 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.073134 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:20.073608 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.073267 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:20.078004 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.077981 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:20.264819 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.264791 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85c48ff4bc-vlb6j" Jul 10 18:36:20.322507 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.322477 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4fbb4849-tw5wq"] Jul 10 18:36:20.470548 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.470465 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:20.572235 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:20.572184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:21.847095 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:21.847060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:21.947770 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:21.947742 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:23.285891 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:23.285857 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:23.351511 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:23.351483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:23.801590 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:23.801548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:23.909046 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:23.909013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:25.282454 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:25.282383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:25.704986 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:25.704907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:28.635561 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:28.635527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:28.703654 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:28.703628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:34.090600 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:34.090568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:36.132200 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:36.132165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:36.237919 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:36.237887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:42.072955 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:42.072874 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:42.173300 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:42.173267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:44.065091 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:44.065061 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:44.399649 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:44.399549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:44.502953 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:44.502915 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:36:45.352952 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.352911 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d4fbb4849-tw5wq" podUID="d0d35600-81b5-4249-8f91-ec1554ee9cd6" containerName="console" containerID="cri-o://e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340" gracePeriod=15 Jul 10 18:36:45.594479 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.594454 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:36:45.626228 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626152 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-service-ca\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626228 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626223 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-oauth-serving-cert\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626244 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-config\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626263 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-serving-cert\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626280 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-trusted-ca-bundle\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626311 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt46b\" (UniqueName: \"kubernetes.io/projected/d0d35600-81b5-4249-8f91-ec1554ee9cd6-kube-api-access-lt46b\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626461 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626339 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-oauth-config\") pod \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\" (UID: \"d0d35600-81b5-4249-8f91-ec1554ee9cd6\") " Jul 10 18:36:45.626732 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626671 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:45.626732 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626712 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:45.626732 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.626720 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-config" (OuterVolumeSpecName: "console-config") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:45.627054 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.627029 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:45.629038 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.629013 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:36:45.629038 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.629022 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d35600-81b5-4249-8f91-ec1554ee9cd6-kube-api-access-lt46b" (OuterVolumeSpecName: "kube-api-access-lt46b") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "kube-api-access-lt46b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:36:45.629171 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.629078 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0d35600-81b5-4249-8f91-ec1554ee9cd6" (UID: "d0d35600-81b5-4249-8f91-ec1554ee9cd6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:36:45.727311 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727264 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-service-ca\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:45.727311 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727307 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-oauth-serving-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:45.727311 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727318 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-config\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:45.727311 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727329 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-serving-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:45.727601 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727338 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d35600-81b5-4249-8f91-ec1554ee9cd6-trusted-ca-bundle\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:45.727601 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727346 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt46b\" (UniqueName: \"kubernetes.io/projected/d0d35600-81b5-4249-8f91-ec1554ee9cd6-kube-api-access-lt46b\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:45.727601 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:45.727354 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d35600-81b5-4249-8f91-ec1554ee9cd6-console-oauth-config\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 18:36:46.367695 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.367655 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0d35600-81b5-4249-8f91-ec1554ee9cd6" containerID="e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340" exitCode=0 Jul 10 18:36:46.368094 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.367706 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4fbb4849-tw5wq" Jul 10 18:36:46.368094 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.367727 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fbb4849-tw5wq" event={"ID":"d0d35600-81b5-4249-8f91-ec1554ee9cd6","Type":"ContainerDied","Data":"e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340"} Jul 10 18:36:46.368094 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.367793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4fbb4849-tw5wq" event={"ID":"d0d35600-81b5-4249-8f91-ec1554ee9cd6","Type":"ContainerDied","Data":"bd415ec4c81b928ae834f62ee7beba685b7b8ba6e79de2d662850cc5eec56624"} Jul 10 18:36:46.368094 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.367815 2567 scope.go:117] "RemoveContainer" containerID="e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340" Jul 10 18:36:46.376285 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.376269 2567 scope.go:117] "RemoveContainer" containerID="e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340" Jul 10 18:36:46.376557 ip-10-0-143-133 kubenswrapper[2567]: E0710 18:36:46.376537 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340\": container with ID starting with e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340 not found: ID does not exist" containerID="e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340" Jul 10 18:36:46.376632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.376569 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340"} err="failed to get container status \"e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340\": rpc error: code = NotFound desc = could not find container \"e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340\": container with ID starting with e7768c6f8e65651d33b546afeecc14d62bf92e4130061d954d685c1acef08340 not found: ID does not exist" Jul 10 18:36:46.389114 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.389087 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4fbb4849-tw5wq"] Jul 10 18:36:46.393040 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:46.393018 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d4fbb4849-tw5wq"] Jul 10 18:36:47.461866 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:47.461835 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d35600-81b5-4249-8f91-ec1554ee9cd6" path="/var/lib/kubelet/pods/d0d35600-81b5-4249-8f91-ec1554ee9cd6/volumes" Jul 10 18:36:59.896973 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:36:59.896938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.061906 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.061873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.386080 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.386049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.459920 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.459889 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp"] Jul 10 18:37:00.460208 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.460196 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d35600-81b5-4249-8f91-ec1554ee9cd6" containerName="console" Jul 10 18:37:00.460266 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.460209 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d35600-81b5-4249-8f91-ec1554ee9cd6" containerName="console" Jul 10 18:37:00.460300 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.460282 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d35600-81b5-4249-8f91-ec1554ee9cd6" containerName="console" Jul 10 18:37:00.463174 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.463154 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.466383 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.466362 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 18:37:00.466518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.466398 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fsjsn\"" Jul 10 18:37:00.466518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.466408 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 18:37:00.466518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.466399 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 18:37:00.466518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.466448 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:37:00.466518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.466480 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 18:37:00.479002 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.478977 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp"] Jul 10 18:37:00.488873 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.488849 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.536362 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.536332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-manager-config\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.536512 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.536383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkgk6\" (UniqueName: \"kubernetes.io/projected/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-kube-api-access-tkgk6\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.536512 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.536446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-cert\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.536512 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.536494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-metrics-cert\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.590732 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.590701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.637267 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.637187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-manager-config\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.637267 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.637242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgk6\" (UniqueName: \"kubernetes.io/projected/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-kube-api-access-tkgk6\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.637267 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.637261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-cert\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.637506 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.637288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-metrics-cert\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.637984 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.637959 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-manager-config\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.639863 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.639840 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-cert\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.639969 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.639895 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-metrics-cert\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.647620 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.647597 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkgk6\" (UniqueName: \"kubernetes.io/projected/2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f-kube-api-access-tkgk6\") pod \"lws-controller-manager-6c6cfb7f55-5phwp\" (UID: \"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f\") " pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.772791 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.772753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:00.860248 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.860218 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.915590 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.915564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp"] Jul 10 18:37:00.918242 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:37:00.918209 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9b02d4_d7d4_4003_8ee3_d9c91748dc0f.slice/crio-62933cbc5cbf151a3a31ce4842bcb25a0021e39ad074112184d2076e4584f41f WatchSource:0}: Error finding container 62933cbc5cbf151a3a31ce4842bcb25a0021e39ad074112184d2076e4584f41f: Status 404 returned error can't find the container with id 62933cbc5cbf151a3a31ce4842bcb25a0021e39ad074112184d2076e4584f41f Jul 10 18:37:00.920104 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.920086 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:37:00.967811 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.967779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:00.994925 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.994893 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq"] Jul 10 18:37:00.997820 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:00.997799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.000547 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.000524 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 18:37:01.000681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.000558 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 18:37:01.000930 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.000906 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 18:37:01.001169 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.001154 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 18:37:01.001258 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.001235 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4lmws\"" Jul 10 18:37:01.038626 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.038594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq"] Jul 10 18:37:01.041309 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.041287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95459d45-8903-4cc5-b104-a62a3636c0f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.041423 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.041321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95459d45-8903-4cc5-b104-a62a3636c0f2-manifests\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.041423 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.041404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95459d45-8903-4cc5-b104-a62a3636c0f2-tmp\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.041552 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.041469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwls\" (UniqueName: \"kubernetes.io/projected/95459d45-8903-4cc5-b104-a62a3636c0f2-kube-api-access-sfwls\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.041552 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.041511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95459d45-8903-4cc5-b104-a62a3636c0f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.142787 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.142746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95459d45-8903-4cc5-b104-a62a3636c0f2-tmp\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.142787 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.142790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwls\" (UniqueName: \"kubernetes.io/projected/95459d45-8903-4cc5-b104-a62a3636c0f2-kube-api-access-sfwls\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.143044 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.142813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95459d45-8903-4cc5-b104-a62a3636c0f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.143044 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.142841 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95459d45-8903-4cc5-b104-a62a3636c0f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.143044 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.142862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95459d45-8903-4cc5-b104-a62a3636c0f2-manifests\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.143199 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.143184 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95459d45-8903-4cc5-b104-a62a3636c0f2-manifests\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.145124 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.145099 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95459d45-8903-4cc5-b104-a62a3636c0f2-tmp\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.145389 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.145368 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95459d45-8903-4cc5-b104-a62a3636c0f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.145472 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.145375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95459d45-8903-4cc5-b104-a62a3636c0f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.153415 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.153390 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwls\" (UniqueName: \"kubernetes.io/projected/95459d45-8903-4cc5-b104-a62a3636c0f2-kube-api-access-sfwls\") pod \"opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq\" (UID: \"95459d45-8903-4cc5-b104-a62a3636c0f2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.224899 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.224870 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:01.308142 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.308113 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:01.324211 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.324182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:01.426213 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.426184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:01.427784 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.427755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" event={"ID":"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f","Type":"ContainerStarted","Data":"62933cbc5cbf151a3a31ce4842bcb25a0021e39ad074112184d2076e4584f41f"} Jul 10 18:37:01.443302 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.443279 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq"] Jul 10 18:37:01.445926 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:37:01.445904 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95459d45_8903_4cc5_b104_a62a3636c0f2.slice/crio-7aae6f96006ac5912a1393e945e3f339bb6e1fd509f660c8772022306b18b50b WatchSource:0}: Error finding container 7aae6f96006ac5912a1393e945e3f339bb6e1fd509f660c8772022306b18b50b: Status 404 returned error can't find the container with id 7aae6f96006ac5912a1393e945e3f339bb6e1fd509f660c8772022306b18b50b Jul 10 18:37:01.782797 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.782743 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:01.884015 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:01.883977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:02.438623 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:02.438523 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" event={"ID":"95459d45-8903-4cc5-b104-a62a3636c0f2","Type":"ContainerStarted","Data":"7aae6f96006ac5912a1393e945e3f339bb6e1fd509f660c8772022306b18b50b"} Jul 10 18:37:06.458093 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:06.458054 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" event={"ID":"2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f","Type":"ContainerStarted","Data":"fc552ac692a6903c9291c49bdd3d77bbd87f8a5d43a5a2dea2baaf467799f587"} Jul 10 18:37:06.458613 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:06.458115 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:06.459532 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:06.459508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" event={"ID":"95459d45-8903-4cc5-b104-a62a3636c0f2","Type":"ContainerStarted","Data":"ddce93e1720f0f4ca50629cdea2b99b33e5a4d6e22b4f85d7eff4afbdaca4e7c"} Jul 10 18:37:06.476702 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:06.476660 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" podStartSLOduration=1.7902225760000001 podStartE2EDuration="6.4766461s" totalImagesPullingTime="4.686423524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:06.475299851 +0000 UTC m=+468.067772070" watchObservedRunningTime="2026-07-10 18:37:06.4766461 +0000 UTC m=+468.069118308" Jul 10 18:37:07.464313 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:07.464273 2567 generic.go:356] "Generic (PLEG): container finished" podID="95459d45-8903-4cc5-b104-a62a3636c0f2" containerID="ddce93e1720f0f4ca50629cdea2b99b33e5a4d6e22b4f85d7eff4afbdaca4e7c" exitCode=0 Jul 10 18:37:07.464706 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:07.464351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" event={"ID":"95459d45-8903-4cc5-b104-a62a3636c0f2","Type":"ContainerDied","Data":"ddce93e1720f0f4ca50629cdea2b99b33e5a4d6e22b4f85d7eff4afbdaca4e7c"} Jul 10 18:37:08.471279 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:08.471237 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" event={"ID":"95459d45-8903-4cc5-b104-a62a3636c0f2","Type":"ContainerStarted","Data":"099014ba90f9604a8e2193469553501b70bbd0fec14a5aceff88571fbe37c95f"} Jul 10 18:37:08.471769 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:08.471334 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:08.492416 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:08.492363 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" podStartSLOduration=2.826027275 podStartE2EDuration="8.492343357s" totalImagesPullingTime="4.54440356s" totalInitContainerRuntime="1.121912522s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:08.490872258 +0000 UTC m=+470.083344458" watchObservedRunningTime="2026-07-10 18:37:08.492343357 +0000 UTC m=+470.084815569" Jul 10 18:37:17.467377 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:17.467347 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c6cfb7f55-5phwp" Jul 10 18:37:19.482449 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:19.482409 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq" Jul 10 18:37:21.090711 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:21.090678 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:21.214711 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:21.214680 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:21.675901 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:21.675867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:21.846240 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:21.846208 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:21.946524 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:21.946413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:22.047010 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:22.046979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:22.144310 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:22.144278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:22.343375 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:22.343342 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:22.686383 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:22.686291 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:23.037314 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:23.037276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:23.110300 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:23.110258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:24.082472 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:24.082415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:29.971018 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.970987 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9"] Jul 10 18:37:29.979158 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.979139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:29.981671 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.981649 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 18:37:29.981781 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.981679 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 18:37:29.981781 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.981697 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h7wqg\"" Jul 10 18:37:29.981875 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.981815 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 18:37:29.981875 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.981854 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 18:37:29.988922 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:29.988901 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9"] Jul 10 18:37:30.088923 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.088891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/328127a4-5112-4c69-8cee-4e4aff22d2cb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.088923 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.088927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.089119 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.088955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.089119 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.089014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcdb5\" (UniqueName: \"kubernetes.io/projected/328127a4-5112-4c69-8cee-4e4aff22d2cb-kube-api-access-wcdb5\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.089119 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.089034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.089119 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.089071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.089119 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.089094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190443 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcdb5\" (UniqueName: \"kubernetes.io/projected/328127a4-5112-4c69-8cee-4e4aff22d2cb-kube-api-access-wcdb5\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/328127a4-5112-4c69-8cee-4e4aff22d2cb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.190636 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.190597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.191169 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.191140 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.193043 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.192981 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.193043 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.193000 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.193240 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.193216 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/328127a4-5112-4c69-8cee-4e4aff22d2cb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.193345 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.193329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.205660 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.205631 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/328127a4-5112-4c69-8cee-4e4aff22d2cb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.205978 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.205959 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcdb5\" (UniqueName: \"kubernetes.io/projected/328127a4-5112-4c69-8cee-4e4aff22d2cb-kube-api-access-wcdb5\") pod \"istiod-openshift-gateway-94bb8fbfd-tj5j9\" (UID: \"328127a4-5112-4c69-8cee-4e4aff22d2cb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.288926 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.288894 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:30.421940 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.421900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9"] Jul 10 18:37:30.424326 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:37:30.424300 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328127a4_5112_4c69_8cee_4e4aff22d2cb.slice/crio-2ed9de10548b94a752a41df2ac7c344f2fba0564663a456e0e507dac5bcf24d3 WatchSource:0}: Error finding container 2ed9de10548b94a752a41df2ac7c344f2fba0564663a456e0e507dac5bcf24d3: Status 404 returned error can't find the container with id 2ed9de10548b94a752a41df2ac7c344f2fba0564663a456e0e507dac5bcf24d3 Jul 10 18:37:30.582505 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:30.582394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" event={"ID":"328127a4-5112-4c69-8cee-4e4aff22d2cb","Type":"ContainerStarted","Data":"2ed9de10548b94a752a41df2ac7c344f2fba0564663a456e0e507dac5bcf24d3"} Jul 10 18:37:32.795013 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:32.794983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:32.888882 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:32.888842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:33.247819 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:33.247785 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:33.365778 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:33.365746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:34.081212 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:34.081172 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:34.171564 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:34.171529 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:35.196451 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:35.196397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:35.297272 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:35.297241 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:35.995609 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:35.995579 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:36.211263 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:36.211226 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:36.417135 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:36.417055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:37:39.227067 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:39.227033 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 18:37:39.227321 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:39.227104 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 18:37:39.626817 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:39.624845 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" event={"ID":"328127a4-5112-4c69-8cee-4e4aff22d2cb","Type":"ContainerStarted","Data":"18021bf59b39ca0f303c6f4ffb7911ec5e206e5f1ab8042b2d2cbe998f5e0734"} Jul 10 18:37:39.626817 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:39.625690 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:39.647177 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:39.647129 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" podStartSLOduration=1.8466573880000001 podStartE2EDuration="10.647115622s" totalImagesPullingTime="8.800458234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:39.646318007 +0000 UTC m=+501.238790231" watchObservedRunningTime="2026-07-10 18:37:39.647115622 +0000 UTC m=+501.239587831" Jul 10 18:37:40.630487 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:40.630459 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tj5j9" Jul 10 18:37:51.620535 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:37:51.620497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:03.099647 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:03.099608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:22.369753 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:22.369707 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:22.667095 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:22.667015 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:22.742649 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:22.742614 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:32.996558 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:32.996525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:44.763203 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:44.763167 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:51.394788 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:51.394754 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:52.008018 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:52.007964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:56.658198 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:56.658147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:58.876662 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:58.876630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:59.014804 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:59.014770 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:38:59.210306 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:38:59.210211 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:01.249359 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:01.249316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:03.063969 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:03.063928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:04.632617 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:04.632560 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:06.234107 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:06.234075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:08.207886 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:08.207845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:08.262028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:08.262000 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:08.609031 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:08.608992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:08.673637 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:08.673602 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:12.210132 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:12.210097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:12.311240 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:12.311205 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:12.672615 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:12.672579 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:12.826963 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:12.826928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:15.416600 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:15.416564 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:15.517201 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:15.517151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:18.876688 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:18.876663 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:39:18.885452 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:18.885410 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:39:18.886681 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:18.886658 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:39:18.894584 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:18.894567 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:39:21.986354 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:21.986299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:22.168513 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:22.168478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:23.466877 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.466846 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr"] Jul 10 18:39:23.470054 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.470027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:23.472719 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.472692 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 18:39:23.473131 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.473110 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 18:39:23.473640 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.473615 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t69vq\"" Jul 10 18:39:23.484222 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.484194 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr"] Jul 10 18:39:23.550897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.550853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mdm\" (UniqueName: \"kubernetes.io/projected/d1f951c5-ac42-4eb5-b139-4996eed958cf-kube-api-access-x9mdm\") pod \"limitador-operator-controller-manager-859d7b78bd-l9fmr\" (UID: \"d1f951c5-ac42-4eb5-b139-4996eed958cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:23.652191 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.652152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mdm\" (UniqueName: \"kubernetes.io/projected/d1f951c5-ac42-4eb5-b139-4996eed958cf-kube-api-access-x9mdm\") pod \"limitador-operator-controller-manager-859d7b78bd-l9fmr\" (UID: \"d1f951c5-ac42-4eb5-b139-4996eed958cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:23.662329 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.662297 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mdm\" (UniqueName: \"kubernetes.io/projected/d1f951c5-ac42-4eb5-b139-4996eed958cf-kube-api-access-x9mdm\") pod \"limitador-operator-controller-manager-859d7b78bd-l9fmr\" (UID: \"d1f951c5-ac42-4eb5-b139-4996eed958cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:23.781558 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.781522 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:23.914090 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:23.914064 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr"] Jul 10 18:39:23.916366 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:39:23.916340 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f951c5_ac42_4eb5_b139_4996eed958cf.slice/crio-d7570e90389e62a3ac5349150a3de19e5966fdbd80f1485cbca876c76841d7e0 WatchSource:0}: Error finding container d7570e90389e62a3ac5349150a3de19e5966fdbd80f1485cbca876c76841d7e0: Status 404 returned error can't find the container with id d7570e90389e62a3ac5349150a3de19e5966fdbd80f1485cbca876c76841d7e0 Jul 10 18:39:24.071184 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:24.071092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" event={"ID":"d1f951c5-ac42-4eb5-b139-4996eed958cf","Type":"ContainerStarted","Data":"d7570e90389e62a3ac5349150a3de19e5966fdbd80f1485cbca876c76841d7e0"} Jul 10 18:39:26.081018 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:26.080984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" event={"ID":"d1f951c5-ac42-4eb5-b139-4996eed958cf","Type":"ContainerStarted","Data":"941d2c9fa11f8232c7e995bea9c8e27fb557a430c196d2d60e65bf7e1b8cade2"} Jul 10 18:39:26.081357 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:26.081057 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:26.105808 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:26.105754 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" podStartSLOduration=1.080078169 podStartE2EDuration="3.105737628s" totalImagesPullingTime="2.025659459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:39:26.104846375 +0000 UTC m=+607.697318582" watchObservedRunningTime="2026-07-10 18:39:26.105737628 +0000 UTC m=+607.698209838" Jul 10 18:39:27.424383 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:27.424352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:27.485008 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:27.484977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:27.829208 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:27.829163 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:27.888237 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:27.888200 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:31.428869 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:31.428835 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:31.529550 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:31.529512 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:35.233990 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:35.233958 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:35.304442 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:35.304392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:36.720512 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:36.720423 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:36.821895 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:36.821851 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:37.088735 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:37.088705 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l9fmr" Jul 10 18:39:43.637639 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:43.637569 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:39:43.737360 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:39:43.737328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:07.646728 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:07.646690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:07.929210 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:07.929131 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:10.711629 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:10.711596 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:10.815161 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:10.815121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:10.898328 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:10.898282 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:11.535093 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:11.535063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:11.595084 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:11.595052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:11.898197 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:11.898095 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:11.958034 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:11.957997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:30.608359 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:30.608312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:30.705420 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:30.705384 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:31.044792 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:31.044752 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:43.575143 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:43.575109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:43.839801 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:43.839706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:49.471152 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:49.471122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:49.565161 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:49.565126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:49.643979 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:49.643942 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:49.963215 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:49.963183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:50.064213 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:50.064176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:50.163720 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:50.163685 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:52.303122 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:52.303050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:53.919181 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:53.919151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:40:54.006958 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:40:54.006919 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:26.552251 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:26.552215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.019509 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.019472 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.441841 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.441760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.537342 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.537310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.627696 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.627660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:27.651859 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.651831 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9dhvv"] Jul 10 18:41:27.655082 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.655063 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.657408 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.657366 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 18:41:27.657601 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.657447 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fnshk\"" Jul 10 18:41:27.664066 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.664046 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9dhvv"] Jul 10 18:41:27.791745 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.791710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c8e161-ee65-4de4-9432-2090a7f9e55c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9dhvv\" (UID: \"44c8e161-ee65-4de4-9432-2090a7f9e55c\") " pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.791918 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.791773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kmtf\" (UniqueName: \"kubernetes.io/projected/44c8e161-ee65-4de4-9432-2090a7f9e55c-kube-api-access-9kmtf\") pod \"payload-pre-processing-7964457696-9dhvv\" (UID: \"44c8e161-ee65-4de4-9432-2090a7f9e55c\") " pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.892720 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.892681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c8e161-ee65-4de4-9432-2090a7f9e55c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9dhvv\" (UID: \"44c8e161-ee65-4de4-9432-2090a7f9e55c\") " pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.892913 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.892755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kmtf\" (UniqueName: \"kubernetes.io/projected/44c8e161-ee65-4de4-9432-2090a7f9e55c-kube-api-access-9kmtf\") pod \"payload-pre-processing-7964457696-9dhvv\" (UID: \"44c8e161-ee65-4de4-9432-2090a7f9e55c\") " pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.893355 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.893333 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44c8e161-ee65-4de4-9432-2090a7f9e55c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9dhvv\" (UID: \"44c8e161-ee65-4de4-9432-2090a7f9e55c\") " pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.900300 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.900282 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kmtf\" (UniqueName: \"kubernetes.io/projected/44c8e161-ee65-4de4-9432-2090a7f9e55c-kube-api-access-9kmtf\") pod \"payload-pre-processing-7964457696-9dhvv\" (UID: \"44c8e161-ee65-4de4-9432-2090a7f9e55c\") " pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:27.966034 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:27.965992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:28.094564 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:28.094538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9dhvv"] Jul 10 18:41:28.096652 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:41:28.096625 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c8e161_ee65_4de4_9432_2090a7f9e55c.slice/crio-4b713defca8a2003d34a92dd092060f52852929f540f026596b81ce81680cad6 WatchSource:0}: Error finding container 4b713defca8a2003d34a92dd092060f52852929f540f026596b81ce81680cad6: Status 404 returned error can't find the container with id 4b713defca8a2003d34a92dd092060f52852929f540f026596b81ce81680cad6 Jul 10 18:41:28.594322 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:28.594288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" event={"ID":"44c8e161-ee65-4de4-9432-2090a7f9e55c","Type":"ContainerStarted","Data":"4b713defca8a2003d34a92dd092060f52852929f540f026596b81ce81680cad6"} Jul 10 18:41:29.600535 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:29.600502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" event={"ID":"44c8e161-ee65-4de4-9432-2090a7f9e55c","Type":"ContainerStarted","Data":"b74f085a03afca18e6941f18e3cd1bcd3bd02a4db97995c0176a4f3a58416eb8"} Jul 10 18:41:29.600923 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:29.600629 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:29.616672 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:29.616503 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" podStartSLOduration=1.352132543 podStartE2EDuration="2.616485052s" totalImagesPullingTime="1.264352509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:29.61600181 +0000 UTC m=+731.208474018" watchObservedRunningTime="2026-07-10 18:41:29.616485052 +0000 UTC m=+731.208957257" Jul 10 18:41:33.038339 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:33.038307 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:37.480109 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:37.480077 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:37.579943 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:37.579911 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:40.606195 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:40.606168 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-9dhvv" Jul 10 18:41:43.583020 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.580532 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw"] Jul 10 18:41:43.586547 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.585342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.588641 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.588609 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 18:41:43.588820 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.588797 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-69xjn\"" Jul 10 18:41:43.589156 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.589132 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 18:41:43.589484 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.589465 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 18:41:43.594441 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.594406 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw"] Jul 10 18:41:43.613405 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.613380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.613543 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.613445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8mt\" (UniqueName: \"kubernetes.io/projected/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-kube-api-access-sn8mt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.613543 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.613469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.613543 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.613493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.613667 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.613587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.613667 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.613621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.614826 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.614804 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:41:43.714705 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.714670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.714705 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.714708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.714982 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.714743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.714982 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.714807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8mt\" (UniqueName: \"kubernetes.io/projected/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-kube-api-access-sn8mt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.714982 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.714839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.714982 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.714868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.715201 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.715182 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.715256 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.715223 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.715335 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.715318 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.716920 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.716897 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.717231 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.717216 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.722712 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.722690 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8mt\" (UniqueName: \"kubernetes.io/projected/b6b57d11-d147-4ae5-a462-fbaec4fdeef7-kube-api-access-sn8mt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw\" (UID: \"b6b57d11-d147-4ae5-a462-fbaec4fdeef7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:43.898339 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:43.898244 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:44.030393 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:44.030362 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw"] Jul 10 18:41:44.033367 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:41:44.033339 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b57d11_d147_4ae5_a462_fbaec4fdeef7.slice/crio-135632f14873e84ade6f61f2570f5743e40882f2169c7d70cdd29ac3cd148cce WatchSource:0}: Error finding container 135632f14873e84ade6f61f2570f5743e40882f2169c7d70cdd29ac3cd148cce: Status 404 returned error can't find the container with id 135632f14873e84ade6f61f2570f5743e40882f2169c7d70cdd29ac3cd148cce Jul 10 18:41:44.667318 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:44.667275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" event={"ID":"b6b57d11-d147-4ae5-a462-fbaec4fdeef7","Type":"ContainerStarted","Data":"135632f14873e84ade6f61f2570f5743e40882f2169c7d70cdd29ac3cd148cce"} Jul 10 18:41:45.673858 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:45.673823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" event={"ID":"b6b57d11-d147-4ae5-a462-fbaec4fdeef7","Type":"ContainerStarted","Data":"84ee8aaf1443aeb69f65846fa11d0bfb129aeee85bb4988dc77687d4bd008f9d"} Jul 10 18:41:45.691235 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:45.691187 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" podStartSLOduration=1.520531555 podStartE2EDuration="2.69117231s" totalImagesPullingTime="1.170640755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:45.689921176 +0000 UTC m=+747.282393385" watchObservedRunningTime="2026-07-10 18:41:45.69117231 +0000 UTC m=+747.283644518" Jul 10 18:41:53.899146 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:53.899093 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:53.899146 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:53.899162 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:53.911748 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:53.911725 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:41:54.726468 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:41:54.726419 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw" Jul 10 18:42:07.226410 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:07.226371 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:11.809564 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:11.809533 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:26.197670 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.197634 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66"] Jul 10 18:42:26.203799 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.203774 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.205964 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.205942 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 10 18:42:26.211280 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.211257 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66"] Jul 10 18:42:26.229481 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.229417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:26.271966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.271936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489a17fb-83df-4e65-b5d5-78d4d45c89c9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.272118 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.271994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgqmk\" (UniqueName: \"kubernetes.io/projected/489a17fb-83df-4e65-b5d5-78d4d45c89c9-kube-api-access-bgqmk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.272118 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.272038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.272118 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.272073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.272226 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.272122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.272226 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.272156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372543 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372543 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372739 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489a17fb-83df-4e65-b5d5-78d4d45c89c9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372739 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqmk\" (UniqueName: \"kubernetes.io/projected/489a17fb-83df-4e65-b5d5-78d4d45c89c9-kube-api-access-bgqmk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372739 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372889 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.372953 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372929 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.373010 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.372990 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.373081 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.373063 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.374897 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.374872 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489a17fb-83df-4e65-b5d5-78d4d45c89c9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.375108 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.375088 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489a17fb-83df-4e65-b5d5-78d4d45c89c9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.380218 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.380194 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqmk\" (UniqueName: \"kubernetes.io/projected/489a17fb-83df-4e65-b5d5-78d4d45c89c9-kube-api-access-bgqmk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66\" (UID: \"489a17fb-83df-4e65-b5d5-78d4d45c89c9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.516620 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.516583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:26.650221 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.650195 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66"] Jul 10 18:42:26.652247 ip-10-0-143-133 kubenswrapper[2567]: W0710 18:42:26.652220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489a17fb_83df_4e65_b5d5_78d4d45c89c9.slice/crio-339707b0d9b546f4cddb2fd87c98348c6cb25b96a074e29c6dbf995452b8ab2e WatchSource:0}: Error finding container 339707b0d9b546f4cddb2fd87c98348c6cb25b96a074e29c6dbf995452b8ab2e: Status 404 returned error can't find the container with id 339707b0d9b546f4cddb2fd87c98348c6cb25b96a074e29c6dbf995452b8ab2e Jul 10 18:42:26.653498 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.653481 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:42:26.858928 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:26.858903 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" event={"ID":"489a17fb-83df-4e65-b5d5-78d4d45c89c9","Type":"ContainerStarted","Data":"339707b0d9b546f4cddb2fd87c98348c6cb25b96a074e29c6dbf995452b8ab2e"} Jul 10 18:42:27.864598 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:27.864560 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" event={"ID":"489a17fb-83df-4e65-b5d5-78d4d45c89c9","Type":"ContainerStarted","Data":"638992c61b2bf21438a098df56eb15cd767d0abd4c75372bed65833d75e7ed39"} Jul 10 18:42:27.882487 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:27.882422 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" podStartSLOduration=1.684701293 podStartE2EDuration="1.882408746s" totalImagesPullingTime="197.707453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:27.880064159 +0000 UTC m=+789.472536393" watchObservedRunningTime="2026-07-10 18:42:27.882408746 +0000 UTC m=+789.474880957" Jul 10 18:42:29.243186 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:29.243155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:33.721188 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:33.721154 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:42:36.516738 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:36.516692 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:36.517132 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:36.516762 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:36.529156 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:36.529124 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:42:36.916085 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:42:36.916001 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66" Jul 10 18:43:24.120914 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:43:24.120879 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:30.723199 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:43:30.723161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:30.855770 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:43:30.855738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:31.840963 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:43:31.840930 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:43:31.941632 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:43:31.941600 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:18.907042 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:18.906945 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:44:18.913930 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:18.913906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:44:18.915539 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:18.915513 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:44:18.922619 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:18.922598 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:44:42.423076 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:42.423040 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:44.505529 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:44.505494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:44:46.126733 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:44:46.126699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:15.064617 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:15.064573 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:16.416830 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:16.416798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:26.547246 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:26.547209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:26.636082 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:26.636046 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:26.744523 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:26.744490 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:32.401737 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:32.401706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:32.463818 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:32.463787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:32.544092 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:32.544062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:32.644329 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:32.644299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:32.748253 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:32.748224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:38.494633 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:38.494585 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:45:38.595276 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:45:38.595237 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:46:52.933151 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:46:52.933120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:47:36.692454 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:47:36.692360 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:49:18.934574 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:49:18.934501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:49:18.940170 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:49:18.940147 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:49:18.943083 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:49:18.943063 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:49:18.949950 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:49:18.949932 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:50:53.603056 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:50:53.603024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:50:54.853484 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:50:54.853423 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:53:52.306179 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:53:52.306126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:54:18.963748 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:54:18.963715 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:54:18.968262 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:54:18.968238 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:54:18.972093 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:54:18.972071 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:54:18.976807 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:54:18.976791 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:55:19.681138 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:55:19.681105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:28.123780 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:28.123697 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:35.525860 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:35.525821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:43.810801 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:43.810763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:48.830122 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:48.830093 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:51.462252 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:51.462209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:51.560514 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:51.560480 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:51.870188 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:51.870139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:57.749968 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:57.749921 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:57.813070 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:57.813041 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:57.961249 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:57.961198 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:58.050928 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:58.050851 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:59.154389 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:59.154359 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:59.259283 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:59.259249 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:59.346623 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:59.346591 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:59.606041 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:59.606010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:56:59.916776 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:56:59.916687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:00.023518 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:00.023485 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:01.781696 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:01.781666 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:04.180952 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:04.180920 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:04.389068 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:04.389027 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:04.506683 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:04.506652 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:04.670215 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:04.670182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:06.241360 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:06.241332 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:10.180463 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:10.180411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:10.247560 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:10.247528 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:10.486216 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:10.486184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:10.569982 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:10.569950 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:11.713671 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:11.713637 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:11.823966 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:11.823938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:11.915017 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:11.914986 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:12.458728 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:12.458698 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:12.559373 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:12.559344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:13.725997 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:13.725967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:16.878827 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:16.878798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:17.334018 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:17.333986 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:23.359513 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:23.359474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:23.469847 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:23.469789 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:29.320198 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:29.320161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:29.421071 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:29.421035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:29.526789 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:29.526744 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:29.825048 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:29.825007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:29.925835 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:29.925803 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:30.615116 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:30.615081 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:30.696970 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:30.696934 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:30.760831 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:30.760801 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:30.859728 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:30.859692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:31.386569 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:31.386537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:31.487421 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:31.487390 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:33.281524 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:33.281494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:35.046379 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:35.046347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:35.222382 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:35.222351 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:35.329400 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:35.329311 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:35.444772 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:35.444741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:37.362087 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:37.362054 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:41.255024 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:41.254953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:41.355975 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:41.355944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:41.693240 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:41.693167 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:41.802225 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:41.802190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:41.939761 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:41.939731 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:43.269594 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:43.269555 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:48.907586 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:48.907551 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:48.975633 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:48.975605 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:49.048479 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:49.048412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:49.150651 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:49.150619 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:57:49.605684 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:57:49.605644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:15.542204 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:15.542170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:21.119907 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:21.119872 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:21.180285 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:21.180253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:21.254828 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:21.254771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:21.352603 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:21.352574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:27.386973 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:27.386941 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:37.143544 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:37.143503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:42.760683 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:42.760630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:42.865224 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:42.865181 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:42.960028 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:42.959997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:53.436031 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:53.435982 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:54.198161 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:54.198110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:58:59.964857 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:58:59.964807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:00.071720 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:00.071689 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:00.169610 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:00.169578 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:00.267150 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:00.267092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:00.958628 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:00.958576 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:01.056675 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:01.056633 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:01.162277 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:01.162234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:02.661852 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:02.661814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:08.470172 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:08.470129 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:08.570699 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:08.570667 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:09.130228 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:09.130193 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:14.862381 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:14.862302 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:14.958219 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:14.958188 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:15.157813 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:15.157733 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:15.452873 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:15.452753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:15.809751 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:15.809712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:18.423575 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:18.423542 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:18.522044 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:18.522007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:18.625076 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:18.625045 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:18.840774 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:18.840741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:18.995973 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:18.995946 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:59:18.998983 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:18.998959 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 18:59:19.005337 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:19.005317 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:59:19.007377 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:19.007359 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 18:59:19.105158 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:19.105070 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:19.208169 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:19.208139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:22.907642 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:22.907605 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:23.552245 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:23.552212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:23.651262 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:23.651234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:23.936848 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:23.936767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:29.776621 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:29.776578 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:29.877241 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:29.877211 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:30.196356 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:30.196272 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:30.540338 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:30.540306 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:30.639971 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:30.639937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:36.348993 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:36.348958 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:36.449661 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:36.449624 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:36.619706 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:36.619628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:36.842309 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:36.842278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:36.952572 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:36.952492 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:37.056510 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:37.056481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:37.158008 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:37.157976 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:43.100139 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:43.100106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:43.204048 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:43.204018 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:43.309057 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:43.309023 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:43.428572 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:43.428498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:49.246584 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:49.246548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:49.347686 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:49.347653 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:50.683034 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:50.682993 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:56.014180 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:56.014147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:56.325052 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:56.324967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:56.657557 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:56.657476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:59.650094 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:59.650049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:59.783573 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:59.783536 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 18:59:59.886192 ip-10-0-143-133 kubenswrapper[2567]: I0710 18:59:59.886142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:00.129215 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.129183 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8"] Jul 10 19:00:00.132709 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.132687 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" Jul 10 19:00:00.135162 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.135144 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-x2bmm\"" Jul 10 19:00:00.140601 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.140570 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8"] Jul 10 19:00:00.144322 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.144304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" Jul 10 19:00:00.251683 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.251645 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:00.280392 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.280282 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8"] Jul 10 19:00:00.283397 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:00:00.283371 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f611525_1b3a_46a0_bf89_bcea28f88bd4.slice/crio-fafb1875d0c5cf8a76f1527c477b1a60deee0bd32ae99b61dba594ed837f924b WatchSource:0}: Error finding container fafb1875d0c5cf8a76f1527c477b1a60deee0bd32ae99b61dba594ed837f924b: Status 404 returned error can't find the container with id fafb1875d0c5cf8a76f1527c477b1a60deee0bd32ae99b61dba594ed837f924b Jul 10 19:00:00.285252 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.285233 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:00:00.406639 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.406557 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:00.510256 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.510219 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:00.551674 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:00.551640 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" event={"ID":"0f611525-1b3a-46a0-bf89-bcea28f88bd4","Type":"ContainerStarted","Data":"fafb1875d0c5cf8a76f1527c477b1a60deee0bd32ae99b61dba594ed837f924b"} Jul 10 19:00:04.196238 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:04.196157 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:04.571743 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:04.571709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" event={"ID":"0f611525-1b3a-46a0-bf89-bcea28f88bd4","Type":"ContainerStarted","Data":"b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0"} Jul 10 19:00:04.587735 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:04.587687 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" podStartSLOduration=1.378928759 podStartE2EDuration="4.587670031s" totalImagesPullingTime="3.208741272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:04.586548698 +0000 UTC m=+1846.179020918" watchObservedRunningTime="2026-07-10 19:00:04.587670031 +0000 UTC m=+1846.180142238" Jul 10 19:00:08.299697 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:08.299656 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:08.400011 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:08.399978 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:20.797401 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.797363 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8"] Jul 10 19:00:20.803186 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.803165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.806468 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.806424 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b39babdc\"/\"openshift-service-ca.crt\"" Jul 10 19:00:20.806604 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.806479 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b39babdc\"/\"kube-root-ca.crt\"" Jul 10 19:00:20.806604 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.806447 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b39babdc\"/\"e2e-lifecycle-model-b39babdc-kserve-self-signed-certs\"" Jul 10 19:00:20.806604 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.806487 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b39babdc\"/\"default-dockercfg-c75qg\"" Jul 10 19:00:20.810630 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.810607 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8"] Jul 10 19:00:20.832793 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.832752 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:20.849048 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.849008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tmp-dir\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.849048 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.849057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-dshm\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.849211 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.849139 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-home\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.849211 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.849178 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-model-cache\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.849277 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.849210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv4fq\" (UniqueName: \"kubernetes.io/projected/8426f4e1-80bd-4c76-8358-acc4e4bbe751-kube-api-access-jv4fq\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.849318 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.849277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tls-certs\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.950556 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tmp-dir\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.950556 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-dshm\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.950791 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-home\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.950791 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-model-cache\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.950791 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv4fq\" (UniqueName: \"kubernetes.io/projected/8426f4e1-80bd-4c76-8358-acc4e4bbe751-kube-api-access-jv4fq\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.950791 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tls-certs\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.951002 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.950968 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tmp-dir\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.951053 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.951028 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-home\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.951094 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.951048 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-model-cache\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.952953 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.952925 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-dshm\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.953073 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.953053 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tls-certs\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:20.959205 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:20.959182 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv4fq\" (UniqueName: \"kubernetes.io/projected/8426f4e1-80bd-4c76-8358-acc4e4bbe751-kube-api-access-jv4fq\") pod \"e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:21.126516 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.126399 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:21.127920 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.127883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:21.225868 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.225838 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:21.264629 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.264594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8"] Jul 10 19:00:21.268568 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:00:21.268539 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8426f4e1_80bd_4c76_8358_acc4e4bbe751.slice/crio-b256ef0de9e5b64f5ec4b2ad28ed04a1ad99b6ea0ce58309f1a09120db908cb4 WatchSource:0}: Error finding container b256ef0de9e5b64f5ec4b2ad28ed04a1ad99b6ea0ce58309f1a09120db908cb4: Status 404 returned error can't find the container with id b256ef0de9e5b64f5ec4b2ad28ed04a1ad99b6ea0ce58309f1a09120db908cb4 Jul 10 19:00:21.655169 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.655133 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" event={"ID":"8426f4e1-80bd-4c76-8358-acc4e4bbe751","Type":"ContainerStarted","Data":"89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047"} Jul 10 19:00:21.655372 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.655177 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" event={"ID":"8426f4e1-80bd-4c76-8358-acc4e4bbe751","Type":"ContainerStarted","Data":"b256ef0de9e5b64f5ec4b2ad28ed04a1ad99b6ea0ce58309f1a09120db908cb4"} Jul 10 19:00:21.672563 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:21.672514 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" podStartSLOduration=1.6724975130000002 podStartE2EDuration="1.672497513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:21.671390194 +0000 UTC m=+1863.263862426" watchObservedRunningTime="2026-07-10 19:00:21.672497513 +0000 UTC m=+1863.264969720" Jul 10 19:00:31.127015 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:31.126977 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:31.127401 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:31.127030 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:31.139406 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:31.139381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:31.716796 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:31.716766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:00:41.695625 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:41.695542 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:42.132966 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:42.132904 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:47.852872 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:47.852838 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:00:52.833703 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:52.833670 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8"] Jul 10 19:00:53.114261 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:00:53.114131 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:00.010185 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:00.010151 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8"] Jul 10 19:01:00.010604 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:00.010343 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" podUID="0f611525-1b3a-46a0-bf89-bcea28f88bd4" containerName="cleanup" containerID="cri-o://b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0" gracePeriod=30 Jul 10 19:01:07.854589 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:07.854514 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" podUID="8426f4e1-80bd-4c76-8358-acc4e4bbe751" containerName="main" containerID="cri-o://89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047" gracePeriod=45 Jul 10 19:01:08.111924 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.111860 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:01:08.177285 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177253 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-dshm\") pod \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " Jul 10 19:01:08.177285 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177290 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-home\") pod \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " Jul 10 19:01:08.177593 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177347 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv4fq\" (UniqueName: \"kubernetes.io/projected/8426f4e1-80bd-4c76-8358-acc4e4bbe751-kube-api-access-jv4fq\") pod \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " Jul 10 19:01:08.177593 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177392 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tls-certs\") pod \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " Jul 10 19:01:08.177593 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177468 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-model-cache\") pod \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " Jul 10 19:01:08.177593 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177486 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tmp-dir\") pod \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\" (UID: \"8426f4e1-80bd-4c76-8358-acc4e4bbe751\") " Jul 10 19:01:08.177593 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177541 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-home" (OuterVolumeSpecName: "home") pod "8426f4e1-80bd-4c76-8358-acc4e4bbe751" (UID: "8426f4e1-80bd-4c76-8358-acc4e4bbe751"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:08.177838 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177739 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-model-cache" (OuterVolumeSpecName: "model-cache") pod "8426f4e1-80bd-4c76-8358-acc4e4bbe751" (UID: "8426f4e1-80bd-4c76-8358-acc4e4bbe751"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:08.177838 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177767 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-home\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:01:08.177943 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.177848 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8426f4e1-80bd-4c76-8358-acc4e4bbe751" (UID: "8426f4e1-80bd-4c76-8358-acc4e4bbe751"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:08.179557 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.179529 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-dshm" (OuterVolumeSpecName: "dshm") pod "8426f4e1-80bd-4c76-8358-acc4e4bbe751" (UID: "8426f4e1-80bd-4c76-8358-acc4e4bbe751"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:01:08.179557 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.179527 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8426f4e1-80bd-4c76-8358-acc4e4bbe751" (UID: "8426f4e1-80bd-4c76-8358-acc4e4bbe751"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:01:08.179696 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.179597 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8426f4e1-80bd-4c76-8358-acc4e4bbe751-kube-api-access-jv4fq" (OuterVolumeSpecName: "kube-api-access-jv4fq") pod "8426f4e1-80bd-4c76-8358-acc4e4bbe751" (UID: "8426f4e1-80bd-4c76-8358-acc4e4bbe751"). InnerVolumeSpecName "kube-api-access-jv4fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:01:08.278794 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.278759 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-model-cache\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:01:08.278934 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.278807 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tmp-dir\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:01:08.278934 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.278816 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8426f4e1-80bd-4c76-8358-acc4e4bbe751-dshm\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:01:08.278934 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.278824 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv4fq\" (UniqueName: \"kubernetes.io/projected/8426f4e1-80bd-4c76-8358-acc4e4bbe751-kube-api-access-jv4fq\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:01:08.278934 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.278833 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8426f4e1-80bd-4c76-8358-acc4e4bbe751-tls-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:01:08.877728 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.877690 2567 generic.go:356] "Generic (PLEG): container finished" podID="8426f4e1-80bd-4c76-8358-acc4e4bbe751" containerID="89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047" exitCode=0 Jul 10 19:01:08.878224 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.877742 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" Jul 10 19:01:08.878224 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.877743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" event={"ID":"8426f4e1-80bd-4c76-8358-acc4e4bbe751","Type":"ContainerDied","Data":"89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047"} Jul 10 19:01:08.878224 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.877883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8" event={"ID":"8426f4e1-80bd-4c76-8358-acc4e4bbe751","Type":"ContainerDied","Data":"b256ef0de9e5b64f5ec4b2ad28ed04a1ad99b6ea0ce58309f1a09120db908cb4"} Jul 10 19:01:08.878224 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.877929 2567 scope.go:117] "RemoveContainer" containerID="89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047" Jul 10 19:01:08.887832 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.887812 2567 scope.go:117] "RemoveContainer" containerID="89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047" Jul 10 19:01:08.888119 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:01:08.888099 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047\": container with ID starting with 89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047 not found: ID does not exist" containerID="89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047" Jul 10 19:01:08.888172 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.888128 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047"} err="failed to get container status \"89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047\": rpc error: code = NotFound desc = could not find container \"89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047\": container with ID starting with 89ab6a9c131057aa04312696b2866ff91cf81d0a7a655113f302f160f1199047 not found: ID does not exist" Jul 10 19:01:08.900567 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.900541 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8"] Jul 10 19:01:08.906621 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:08.906598 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b39babdc/e2e-lifecycle-model-b39babdc-kserve-95cb798f9-82sw8"] Jul 10 19:01:09.464633 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:09.464601 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8426f4e1-80bd-4c76-8358-acc4e4bbe751" path="/var/lib/kubelet/pods/8426f4e1-80bd-4c76-8358-acc4e4bbe751/volumes" Jul 10 19:01:29.072998 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:29.072959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:30.212485 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.212455 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" Jul 10 19:01:30.269030 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.268940 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:30.977373 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.977337 2567 generic.go:356] "Generic (PLEG): container finished" podID="0f611525-1b3a-46a0-bf89-bcea28f88bd4" containerID="b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0" exitCode=137 Jul 10 19:01:30.977571 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.977381 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" Jul 10 19:01:30.977571 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.977444 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" event={"ID":"0f611525-1b3a-46a0-bf89-bcea28f88bd4","Type":"ContainerDied","Data":"b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0"} Jul 10 19:01:30.977571 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.977499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8" event={"ID":"0f611525-1b3a-46a0-bf89-bcea28f88bd4","Type":"ContainerDied","Data":"fafb1875d0c5cf8a76f1527c477b1a60deee0bd32ae99b61dba594ed837f924b"} Jul 10 19:01:30.977571 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.977525 2567 scope.go:117] "RemoveContainer" containerID="b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0" Jul 10 19:01:30.985920 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.985903 2567 scope.go:117] "RemoveContainer" containerID="b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0" Jul 10 19:01:30.986173 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:01:30.986156 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0\": container with ID starting with b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0 not found: ID does not exist" containerID="b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0" Jul 10 19:01:30.986244 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.986181 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0"} err="failed to get container status \"b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0\": rpc error: code = NotFound desc = could not find container \"b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0\": container with ID starting with b18871e723b2765c86d527ea8314f14db21cc536455fd7141ea4431e055556c0 not found: ID does not exist" Jul 10 19:01:30.997637 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:30.997615 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8"] Jul 10 19:01:31.001245 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:31.001225 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-ztkq8"] Jul 10 19:01:31.463177 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:31.463095 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f611525-1b3a-46a0-bf89-bcea28f88bd4" path="/var/lib/kubelet/pods/0f611525-1b3a-46a0-bf89-bcea28f88bd4/volumes" Jul 10 19:01:35.657087 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:35.657052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:35.757507 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:35.757473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:35.964829 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:35.964744 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:36.268804 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:36.268755 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:37.472313 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:37.472270 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:37.573105 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:37.573072 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:37.672838 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:37.672801 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:38.532403 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:38.532363 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:38.631660 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:38.631610 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:38.733243 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:38.733208 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:40.350028 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:40.349984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:46.131131 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:46.131095 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:46.195753 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:46.195720 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:46.932843 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:46.932810 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:52.751624 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:52.751586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:52.814537 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:52.814504 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:52.893941 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:52.893900 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:01:52.994477 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:01:52.994442 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:03.542700 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:03.542663 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:03.888967 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:03.888885 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:24.881939 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:24.881907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:30.646053 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:30.646021 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:30.707744 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:30.707714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:31.015020 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:31.014982 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:31.345081 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:31.344999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:31.444089 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:31.444058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:34.565843 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:34.565808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:34.665007 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:34.664969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:34.840875 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:34.840775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:34.993250 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:34.993216 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:35.482837 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:35.482807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:35.580969 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:35.580933 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:39.127241 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.127201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:39.471656 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.471568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:39.771175 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771136 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg"] Jul 10 19:02:39.771674 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771653 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f611525-1b3a-46a0-bf89-bcea28f88bd4" containerName="cleanup" Jul 10 19:02:39.771857 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771836 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f611525-1b3a-46a0-bf89-bcea28f88bd4" containerName="cleanup" Jul 10 19:02:39.771985 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771885 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8426f4e1-80bd-4c76-8358-acc4e4bbe751" containerName="main" Jul 10 19:02:39.771985 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771894 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8426f4e1-80bd-4c76-8358-acc4e4bbe751" containerName="main" Jul 10 19:02:39.771985 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771979 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8426f4e1-80bd-4c76-8358-acc4e4bbe751" containerName="main" Jul 10 19:02:39.772165 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.771992 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f611525-1b3a-46a0-bf89-bcea28f88bd4" containerName="cleanup" Jul 10 19:02:39.775260 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.775238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.777522 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.777502 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-12e952-openshift-default-dockercfg-6gm2d\"" Jul 10 19:02:39.786914 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.786888 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg"] Jul 10 19:02:39.804855 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.804824 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:39.870754 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.870724 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:39.944194 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-data\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944386 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-credential-socket\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944386 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944260 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z6wv\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-kube-api-access-2z6wv\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944386 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-certs\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944386 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e516f97-08ce-418e-9494-027099064ce5-istio-podinfo\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944386 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-istio-token\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944641 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-socket\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944641 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e516f97-08ce-418e-9494-027099064ce5-istiod-ca-cert\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:39.944641 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:39.944536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-envoy\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045473 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-data\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045473 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-credential-socket\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z6wv\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-kube-api-access-2z6wv\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-certs\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e516f97-08ce-418e-9494-027099064ce5-istio-podinfo\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-istio-token\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-socket\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.045702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e516f97-08ce-418e-9494-027099064ce5-istiod-ca-cert\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.046005 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-envoy\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.046005 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045824 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-data\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.046005 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.045896 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-certs\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.046169 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.046091 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-credential-socket\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.046169 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.046152 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-socket\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.046515 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.046495 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e516f97-08ce-418e-9494-027099064ce5-istiod-ca-cert\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.048298 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.048274 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-envoy\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.048450 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.048408 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e516f97-08ce-418e-9494-027099064ce5-istio-podinfo\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.054107 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.054085 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-istio-token\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.054329 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.054312 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z6wv\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-kube-api-access-2z6wv\") pod \"e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.085986 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.085963 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:40.219838 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.219803 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg"] Jul 10 19:02:40.222935 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:02:40.222902 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e516f97_08ce_418e_9494_027099064ce5.slice/crio-e6b35f78cff61f77ea5785b7df6040b7b71217a148c68af01424c4215995faa1 WatchSource:0}: Error finding container e6b35f78cff61f77ea5785b7df6040b7b71217a148c68af01424c4215995faa1: Status 404 returned error can't find the container with id e6b35f78cff61f77ea5785b7df6040b7b71217a148c68af01424c4215995faa1 Jul 10 19:02:40.285491 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:40.285455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" event={"ID":"2e516f97-08ce-418e-9494-027099064ce5","Type":"ContainerStarted","Data":"e6b35f78cff61f77ea5785b7df6040b7b71217a148c68af01424c4215995faa1"} Jul 10 19:02:42.941945 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:42.941909 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:02:42.942207 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:42.941977 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:02:42.942207 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:42.942013 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:02:43.303860 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:43.303825 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" event={"ID":"2e516f97-08ce-418e-9494-027099064ce5","Type":"ContainerStarted","Data":"b67a04fab85a195cbab4274e84c3621a7dd0fa3300078d0f971bc7a8b04de0bf"} Jul 10 19:02:43.324279 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:43.324234 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podStartSLOduration=1.607655828 podStartE2EDuration="4.324218198s" totalImagesPullingTime="2.71656237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:02:43.321945659 +0000 UTC m=+2004.914417893" watchObservedRunningTime="2026-07-10 19:02:43.324218198 +0000 UTC m=+2004.916690405" Jul 10 19:02:44.087075 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:44.087034 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:44.091920 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:44.091892 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:44.308654 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:44.308624 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:44.309659 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:44.309640 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:02:45.300921 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:45.300886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:45.400441 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:45.400394 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:45.493351 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:45.493320 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:45.797125 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:45.797090 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:45.957045 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:45.957012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:46.058792 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:46.058713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:49.809709 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:49.809678 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:51.189802 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.189765 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg"] Jul 10 19:02:51.193406 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.193383 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.196007 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.195972 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6b8252\"/\"test-model-6b8252-kserve-self-signed-certs\"" Jul 10 19:02:51.196104 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.195981 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6b8252\"/\"openshift-service-ca.crt\"" Jul 10 19:02:51.196104 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.196050 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6b8252\"/\"kube-root-ca.crt\"" Jul 10 19:02:51.196202 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.196100 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6b8252\"/\"default-dockercfg-2htfb\"" Jul 10 19:02:51.202947 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.202923 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg"] Jul 10 19:02:51.216881 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.216845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:51.246042 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.246011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-dshm\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.246172 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.246047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrlg9\" (UniqueName: \"kubernetes.io/projected/8768d12e-062c-4c19-8a99-085d10fe5d2d-kube-api-access-rrlg9\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.246172 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.246071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-model-cache\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.246172 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.246148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-home\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.246172 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.246165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768d12e-062c-4c19-8a99-085d10fe5d2d-tls-certs\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.246303 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.246198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-tmp-dir\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.346672 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.346641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-dshm\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.346672 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.346674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrlg9\" (UniqueName: \"kubernetes.io/projected/8768d12e-062c-4c19-8a99-085d10fe5d2d-kube-api-access-rrlg9\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.346899 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.346692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-model-cache\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.346899 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.346759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-home\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.346899 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.346785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768d12e-062c-4c19-8a99-085d10fe5d2d-tls-certs\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.346899 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.346828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-tmp-dir\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.347154 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.347125 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-model-cache\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.347224 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.347171 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-home\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.347224 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.347197 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-tmp-dir\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.348989 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.348967 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-dshm\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.349242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.349223 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768d12e-062c-4c19-8a99-085d10fe5d2d-tls-certs\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.355739 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.355718 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrlg9\" (UniqueName: \"kubernetes.io/projected/8768d12e-062c-4c19-8a99-085d10fe5d2d-kube-api-access-rrlg9\") pod \"test-model-6b8252-kserve-777785c47-pv8tg\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.515396 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.515362 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:02:51.648699 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:51.648670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg"] Jul 10 19:02:51.651325 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:02:51.651297 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8768d12e_062c_4c19_8a99_085d10fe5d2d.slice/crio-6e222443a20c60023b10e4d2814fe607db70de2b3c3b4e9b4d80a4bff84e7822 WatchSource:0}: Error finding container 6e222443a20c60023b10e4d2814fe607db70de2b3c3b4e9b4d80a4bff84e7822: Status 404 returned error can't find the container with id 6e222443a20c60023b10e4d2814fe607db70de2b3c3b4e9b4d80a4bff84e7822 Jul 10 19:02:52.350739 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:52.350700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" event={"ID":"8768d12e-062c-4c19-8a99-085d10fe5d2d","Type":"ContainerStarted","Data":"93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f"} Jul 10 19:02:52.351299 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:52.351275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" event={"ID":"8768d12e-062c-4c19-8a99-085d10fe5d2d","Type":"ContainerStarted","Data":"6e222443a20c60023b10e4d2814fe607db70de2b3c3b4e9b4d80a4bff84e7822"} Jul 10 19:02:52.389892 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:52.389835 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" podStartSLOduration=1.389819503 podStartE2EDuration="1.389819503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:02:52.386668773 +0000 UTC m=+2013.979140981" watchObservedRunningTime="2026-07-10 19:02:52.389819503 +0000 UTC m=+2013.982291743" Jul 10 19:02:55.362762 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:55.362713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:56.310638 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:56.310602 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:56.410659 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:56.410627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:02:59.310052 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.310017 2567 patch_prober.go:28] interesting pod/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 19:02:59.310473 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.310077 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 19:02:59.385613 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.385581 2567 generic.go:356] "Generic (PLEG): container finished" podID="2e516f97-08ce-418e-9494-027099064ce5" containerID="b67a04fab85a195cbab4274e84c3621a7dd0fa3300078d0f971bc7a8b04de0bf" exitCode=0 Jul 10 19:02:59.385778 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.385656 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" event={"ID":"2e516f97-08ce-418e-9494-027099064ce5","Type":"ContainerDied","Data":"b67a04fab85a195cbab4274e84c3621a7dd0fa3300078d0f971bc7a8b04de0bf"} Jul 10 19:02:59.386055 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.386041 2567 scope.go:117] "RemoveContainer" containerID="b67a04fab85a195cbab4274e84c3621a7dd0fa3300078d0f971bc7a8b04de0bf" Jul 10 19:02:59.387028 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.387001 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:02:59.387092 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.387079 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:02:59.387128 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:02:59.387114 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:03:00.392318 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:00.392280 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" event={"ID":"2e516f97-08ce-418e-9494-027099064ce5","Type":"ContainerStarted","Data":"4f6f98bf03f127701ea6e095417eada67c4443b20b8febbe2baa208a86766250"} Jul 10 19:03:01.086819 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:01.086780 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:03:01.087147 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:01.087122 2567 patch_prober.go:28] interesting pod/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 19:03:01.087248 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:01.087181 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 19:03:01.515871 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:01.515826 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:03:01.515871 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:01.515875 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:03:01.529035 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:01.528992 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:03:02.087309 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:02.087269 2567 patch_prober.go:28] interesting pod/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 19:03:02.087539 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:02.087335 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 19:03:02.414777 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:02.414686 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:03:03.086776 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:03.086738 2567 patch_prober.go:28] interesting pod/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 19:03:03.087165 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:03.086797 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 19:03:04.086731 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:04.086694 2567 patch_prober.go:28] interesting pod/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 10 19:03:04.086915 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:04.086757 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 10 19:03:05.090829 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:05.090791 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:03:05.091280 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:05.091170 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:03:05.091942 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:05.091921 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:03:06.689670 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:06.689636 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:06.788989 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:06.788951 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:16.109206 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:16.109159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:32.866319 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:32.866283 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg"] Jul 10 19:03:32.890512 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:32.890483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:33.863909 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:33.863871 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:33.963793 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:33.963746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:34.318583 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:34.318535 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:34.418851 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:34.418806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:34.534829 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:34.534779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:34.804565 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:34.804516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:39.361035 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:39.360997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:03:47.886921 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:47.886804 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" podUID="8768d12e-062c-4c19-8a99-085d10fe5d2d" containerName="main" containerID="cri-o://93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f" gracePeriod=45 Jul 10 19:03:48.130619 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.130597 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:03:48.152037 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.151976 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-tmp-dir\") pod \"8768d12e-062c-4c19-8a99-085d10fe5d2d\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " Jul 10 19:03:48.152037 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152011 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-dshm\") pod \"8768d12e-062c-4c19-8a99-085d10fe5d2d\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " Jul 10 19:03:48.152037 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152026 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-home\") pod \"8768d12e-062c-4c19-8a99-085d10fe5d2d\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " Jul 10 19:03:48.152272 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152103 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrlg9\" (UniqueName: \"kubernetes.io/projected/8768d12e-062c-4c19-8a99-085d10fe5d2d-kube-api-access-rrlg9\") pod \"8768d12e-062c-4c19-8a99-085d10fe5d2d\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " Jul 10 19:03:48.152272 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152118 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768d12e-062c-4c19-8a99-085d10fe5d2d-tls-certs\") pod \"8768d12e-062c-4c19-8a99-085d10fe5d2d\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " Jul 10 19:03:48.152272 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152149 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-model-cache\") pod \"8768d12e-062c-4c19-8a99-085d10fe5d2d\" (UID: \"8768d12e-062c-4c19-8a99-085d10fe5d2d\") " Jul 10 19:03:48.152272 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152223 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8768d12e-062c-4c19-8a99-085d10fe5d2d" (UID: "8768d12e-062c-4c19-8a99-085d10fe5d2d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:03:48.152516 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152452 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-model-cache" (OuterVolumeSpecName: "model-cache") pod "8768d12e-062c-4c19-8a99-085d10fe5d2d" (UID: "8768d12e-062c-4c19-8a99-085d10fe5d2d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:03:48.152516 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152456 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-tmp-dir\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:03:48.152516 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.152508 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-home" (OuterVolumeSpecName: "home") pod "8768d12e-062c-4c19-8a99-085d10fe5d2d" (UID: "8768d12e-062c-4c19-8a99-085d10fe5d2d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:03:48.154383 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.154357 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8768d12e-062c-4c19-8a99-085d10fe5d2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8768d12e-062c-4c19-8a99-085d10fe5d2d" (UID: "8768d12e-062c-4c19-8a99-085d10fe5d2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:03:48.154666 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.154649 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-dshm" (OuterVolumeSpecName: "dshm") pod "8768d12e-062c-4c19-8a99-085d10fe5d2d" (UID: "8768d12e-062c-4c19-8a99-085d10fe5d2d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:03:48.154753 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.154694 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8768d12e-062c-4c19-8a99-085d10fe5d2d-kube-api-access-rrlg9" (OuterVolumeSpecName: "kube-api-access-rrlg9") pod "8768d12e-062c-4c19-8a99-085d10fe5d2d" (UID: "8768d12e-062c-4c19-8a99-085d10fe5d2d"). InnerVolumeSpecName "kube-api-access-rrlg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:03:48.253455 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.253392 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrlg9\" (UniqueName: \"kubernetes.io/projected/8768d12e-062c-4c19-8a99-085d10fe5d2d-kube-api-access-rrlg9\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:03:48.253455 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.253424 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768d12e-062c-4c19-8a99-085d10fe5d2d-tls-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:03:48.253455 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.253458 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-model-cache\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:03:48.253455 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.253466 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-dshm\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:03:48.253717 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.253474 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768d12e-062c-4c19-8a99-085d10fe5d2d-home\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:03:48.618226 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.618190 2567 generic.go:356] "Generic (PLEG): container finished" podID="8768d12e-062c-4c19-8a99-085d10fe5d2d" containerID="93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f" exitCode=0 Jul 10 19:03:48.618226 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.618233 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" Jul 10 19:03:48.618486 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.618270 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" event={"ID":"8768d12e-062c-4c19-8a99-085d10fe5d2d","Type":"ContainerDied","Data":"93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f"} Jul 10 19:03:48.618486 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.618319 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg" event={"ID":"8768d12e-062c-4c19-8a99-085d10fe5d2d","Type":"ContainerDied","Data":"6e222443a20c60023b10e4d2814fe607db70de2b3c3b4e9b4d80a4bff84e7822"} Jul 10 19:03:48.618486 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.618337 2567 scope.go:117] "RemoveContainer" containerID="93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f" Jul 10 19:03:48.627512 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.627495 2567 scope.go:117] "RemoveContainer" containerID="93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f" Jul 10 19:03:48.627763 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:03:48.627738 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f\": container with ID starting with 93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f not found: ID does not exist" containerID="93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f" Jul 10 19:03:48.627814 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.627764 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f"} err="failed to get container status \"93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f\": rpc error: code = NotFound desc = could not find container \"93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f\": container with ID starting with 93749e373cb0e6cd9885ca37ac3283d9d45c401062be2ee1749c84044986162f not found: ID does not exist" Jul 10 19:03:48.638922 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.638897 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg"] Jul 10 19:03:48.644731 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:48.644710 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6b8252/test-model-6b8252-kserve-777785c47-pv8tg"] Jul 10 19:03:49.462669 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:49.462635 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8768d12e-062c-4c19-8a99-085d10fe5d2d" path="/var/lib/kubelet/pods/8768d12e-062c-4c19-8a99-085d10fe5d2d/volumes" Jul 10 19:03:52.024479 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:03:52.024446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:16.225859 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:16.225825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:16.486808 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:16.486707 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:16.692716 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:16.692679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:16.927203 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:16.927106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:17.311529 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:17.311497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:17.514776 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:17.514748 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:17.616164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:17.616074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:17.780565 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:17.780535 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:19.026140 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:19.026112 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 19:04:19.027085 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:19.027061 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 19:04:19.034531 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:19.034512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 19:04:19.035687 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:19.035667 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 19:04:23.334142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:23.334106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:23.398035 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:23.398010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:23.568983 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:23.568948 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg"] Jul 10 19:04:23.569195 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:23.569154 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" containerID="cri-o://4f6f98bf03f127701ea6e095417eada67c4443b20b8febbe2baa208a86766250" gracePeriod=30 Jul 10 19:04:23.592710 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:23.592641 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:23.797323 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:23.797289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:24.105285 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.105253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:24.374285 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.374200 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh"] Jul 10 19:04:24.374746 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.374589 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8768d12e-062c-4c19-8a99-085d10fe5d2d" containerName="main" Jul 10 19:04:24.374746 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.374603 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8768d12e-062c-4c19-8a99-085d10fe5d2d" containerName="main" Jul 10 19:04:24.374746 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.374668 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8768d12e-062c-4c19-8a99-085d10fe5d2d" containerName="main" Jul 10 19:04:24.377104 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.377084 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.379404 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.379383 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3870b4-openshift-default-dockercfg-mv27d\"" Jul 10 19:04:24.392795 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.392773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh"] Jul 10 19:04:24.404861 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.404837 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:24.473132 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-envoy\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473335 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-data\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473335 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xzfd\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-kube-api-access-9xzfd\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473335 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-podinfo\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473527 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-certs\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473527 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-socket\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473682 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-token\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473682 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istiod-ca-cert\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.473682 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.473627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-credential-socket\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.574761 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.574724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xzfd\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-kube-api-access-9xzfd\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.574957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.574766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-podinfo\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.574957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.574904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-certs\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575083 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.574955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-socket\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575083 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-token\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575083 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istiod-ca-cert\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575239 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-credential-socket\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575239 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-envoy\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575239 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-data\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575410 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575383 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-socket\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575525 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575502 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-credential-socket\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575597 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-data\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575717 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575688 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-certs\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.575828 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.575779 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istiod-ca-cert\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.577509 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.577480 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-envoy\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.577582 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.577522 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-podinfo\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.585128 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.585096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-token\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.585511 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.585489 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xzfd\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-kube-api-access-9xzfd\") pod \"e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.688650 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.688562 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:24.837621 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.837595 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh"] Jul 10 19:04:24.840887 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:04:24.840861 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c15023_822d_48c9_9f1e_72c0f23a8bb6.slice/crio-f1cac3d71fa8abb259e50e64f00cee46df0734330d773430b911a358ec4d05c5 WatchSource:0}: Error finding container f1cac3d71fa8abb259e50e64f00cee46df0734330d773430b911a358ec4d05c5: Status 404 returned error can't find the container with id f1cac3d71fa8abb259e50e64f00cee46df0734330d773430b911a358ec4d05c5 Jul 10 19:04:24.843038 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.843004 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:24.843128 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.843085 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:24.843190 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.843131 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:24.956564 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:24.956462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:25.791398 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:25.791365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" event={"ID":"42c15023-822d-48c9-9f1e-72c0f23a8bb6","Type":"ContainerStarted","Data":"e29c55ee33a2df40752716b2b046ecf5c39c934bbf90473affadb0810c211496"} Jul 10 19:04:25.791788 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:25.791411 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" event={"ID":"42c15023-822d-48c9-9f1e-72c0f23a8bb6","Type":"ContainerStarted","Data":"f1cac3d71fa8abb259e50e64f00cee46df0734330d773430b911a358ec4d05c5"} Jul 10 19:04:25.813814 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:25.813767 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podStartSLOduration=1.813750647 podStartE2EDuration="1.813750647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:25.811174956 +0000 UTC m=+2107.403647164" watchObservedRunningTime="2026-07-10 19:04:25.813750647 +0000 UTC m=+2107.406222854" Jul 10 19:04:26.688788 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:26.688742 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:26.693493 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:26.693469 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:26.796234 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:26.796191 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:26.797140 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:26.797120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:27.691383 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:27.691337 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:27.778317 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:27.778280 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:27.845266 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:27.845209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:28.213771 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.213735 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:28.310986 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.310953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:28.411674 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.411644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:28.807693 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.807665 2567 generic.go:356] "Generic (PLEG): container finished" podID="2e516f97-08ce-418e-9494-027099064ce5" containerID="4f6f98bf03f127701ea6e095417eada67c4443b20b8febbe2baa208a86766250" exitCode=0 Jul 10 19:04:28.807817 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.807736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" event={"ID":"2e516f97-08ce-418e-9494-027099064ce5","Type":"ContainerDied","Data":"4f6f98bf03f127701ea6e095417eada67c4443b20b8febbe2baa208a86766250"} Jul 10 19:04:28.807817 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.807803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" event={"ID":"2e516f97-08ce-418e-9494-027099064ce5","Type":"ContainerDied","Data":"e6b35f78cff61f77ea5785b7df6040b7b71217a148c68af01424c4215995faa1"} Jul 10 19:04:28.807902 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.807831 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6b35f78cff61f77ea5785b7df6040b7b71217a148c68af01424c4215995faa1" Jul 10 19:04:28.807902 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.807850 2567 scope.go:117] "RemoveContainer" containerID="b67a04fab85a195cbab4274e84c3621a7dd0fa3300078d0f971bc7a8b04de0bf" Jul 10 19:04:28.813622 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.813597 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:04:28.914651 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914554 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-socket\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.914651 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914597 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e516f97-08ce-418e-9494-027099064ce5-istio-podinfo\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.914651 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914613 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-envoy\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.914651 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914635 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e516f97-08ce-418e-9494-027099064ce5-istiod-ca-cert\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914660 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-certs\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914709 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-data\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914749 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z6wv\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-kube-api-access-2z6wv\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914775 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-istio-token\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914823 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-credential-socket\") pod \"2e516f97-08ce-418e-9494-027099064ce5\" (UID: \"2e516f97-08ce-418e-9494-027099064ce5\") " Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.914892 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.915072 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.915089 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e516f97-08ce-418e-9494-027099064ce5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.915201 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.915219 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e516f97-08ce-418e-9494-027099064ce5-istiod-ca-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:28.915274 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.915234 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-workload-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:28.915878 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.915538 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:04:28.916035 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.916004 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:04:28.917049 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.917031 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:04:28.917155 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.917138 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:04:28.917246 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.917230 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e516f97-08ce-418e-9494-027099064ce5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:04:28.917743 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:28.917720 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-kube-api-access-2z6wv" (OuterVolumeSpecName: "kube-api-access-2z6wv") pod "2e516f97-08ce-418e-9494-027099064ce5" (UID: "2e516f97-08ce-418e-9494-027099064ce5"). InnerVolumeSpecName "kube-api-access-2z6wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:04:29.016736 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.016701 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z6wv\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-kube-api-access-2z6wv\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:29.016736 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.016732 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e516f97-08ce-418e-9494-027099064ce5-istio-token\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:29.016736 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.016741 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-credential-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:29.016960 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.016750 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e516f97-08ce-418e-9494-027099064ce5-istio-podinfo\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:29.016960 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.016759 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-envoy\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:29.016960 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.016766 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e516f97-08ce-418e-9494-027099064ce5-istio-data\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:04:29.819738 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.819711 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg" Jul 10 19:04:29.854598 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.854563 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg"] Jul 10 19:04:29.858606 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:29.858580 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-12e952-openshift-default-55f898c66c-jklmg"] Jul 10 19:04:31.304276 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:31.304189 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:31.359343 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:31.359308 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:31.462691 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:31.462658 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e516f97-08ce-418e-9494-027099064ce5" path="/var/lib/kubelet/pods/2e516f97-08ce-418e-9494-027099064ce5/volumes" Jul 10 19:04:32.165991 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.165958 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:32.628625 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.628592 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:32.911340 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911256 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d"] Jul 10 19:04:32.911822 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911803 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" Jul 10 19:04:32.911876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911827 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" Jul 10 19:04:32.911876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911867 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" Jul 10 19:04:32.911978 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911876 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" Jul 10 19:04:32.911978 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911965 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" Jul 10 19:04:32.912046 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.911979 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e516f97-08ce-418e-9494-027099064ce5" containerName="istio-proxy" Jul 10 19:04:32.915617 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.915589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.917892 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.917873 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ba3fa5-openshift-default-dockercfg-mcnc8\"" Jul 10 19:04:32.927005 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.926983 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d"] Jul 10 19:04:32.943571 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.943545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:32.954395 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-certs\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954518 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-data\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954518 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-token\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954602 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-podinfo\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954602 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-credential-socket\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954667 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hsm\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-kube-api-access-q2hsm\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954667 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954643 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-envoy\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954734 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-socket\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:32.954734 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:32.954724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/046d5fcd-b9da-4505-a229-1b7f067b68db-istiod-ca-cert\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055143 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-certs\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055310 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-data\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055310 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-token\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055310 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-podinfo\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055310 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-credential-socket\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055310 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hsm\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-kube-api-access-q2hsm\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055630 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-envoy\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055630 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-socket\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055630 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/046d5fcd-b9da-4505-a229-1b7f067b68db-istiod-ca-cert\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055630 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055607 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-certs\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055846 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055641 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-data\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055846 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055663 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-credential-socket\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.055955 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.055898 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-socket\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.056155 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.056135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/046d5fcd-b9da-4505-a229-1b7f067b68db-istiod-ca-cert\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.057798 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.057781 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-podinfo\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.058018 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.058001 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-envoy\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.063050 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.063021 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-token\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.063740 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.063722 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hsm\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-kube-api-access-q2hsm\") pod \"e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.227654 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.227616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:33.285553 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.285462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:33.368447 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.368404 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d"] Jul 10 19:04:33.370200 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:04:33.370157 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046d5fcd_b9da_4505_a229_1b7f067b68db.slice/crio-6e505a5a37fb470814fafce510f2aeeca27786e50b2d507708d86ce3d7b4c311 WatchSource:0}: Error finding container 6e505a5a37fb470814fafce510f2aeeca27786e50b2d507708d86ce3d7b4c311: Status 404 returned error can't find the container with id 6e505a5a37fb470814fafce510f2aeeca27786e50b2d507708d86ce3d7b4c311 Jul 10 19:04:33.372264 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.372232 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:33.372353 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.372294 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:33.372353 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.372321 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:33.838655 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.838623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" event={"ID":"046d5fcd-b9da-4505-a229-1b7f067b68db","Type":"ContainerStarted","Data":"caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef"} Jul 10 19:04:33.839140 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.838675 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" event={"ID":"046d5fcd-b9da-4505-a229-1b7f067b68db","Type":"ContainerStarted","Data":"6e505a5a37fb470814fafce510f2aeeca27786e50b2d507708d86ce3d7b4c311"} Jul 10 19:04:33.859166 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:33.859044 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podStartSLOduration=1.859024882 podStartE2EDuration="1.859024882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:33.858763412 +0000 UTC m=+2115.451235624" watchObservedRunningTime="2026-07-10 19:04:33.859024882 +0000 UTC m=+2115.451497091" Jul 10 19:04:34.228643 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:34.228605 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:34.233614 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:34.233591 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:34.843085 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:34.843048 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:34.844089 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:34.844071 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:35.771818 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:35.771777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:35.845632 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:35.845595 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:35.925064 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:35.925034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:36.094490 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:36.094383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:36.365147 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:36.365042 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:36.465965 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:36.465928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:40.273291 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:40.273252 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:42.838663 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:42.838619 2567 patch_prober.go:28] interesting pod/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 19:04:42.839141 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:42.838700 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 19:04:44.894698 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:44.894609 2567 generic.go:356] "Generic (PLEG): container finished" podID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerID="e29c55ee33a2df40752716b2b046ecf5c39c934bbf90473affadb0810c211496" exitCode=0 Jul 10 19:04:44.894698 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:44.894681 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" event={"ID":"42c15023-822d-48c9-9f1e-72c0f23a8bb6","Type":"ContainerDied","Data":"e29c55ee33a2df40752716b2b046ecf5c39c934bbf90473affadb0810c211496"} Jul 10 19:04:44.895140 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:44.895090 2567 scope.go:117] "RemoveContainer" containerID="e29c55ee33a2df40752716b2b046ecf5c39c934bbf90473affadb0810c211496" Jul 10 19:04:44.896077 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:44.896052 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:44.896179 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:44.896114 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:44.896179 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:44.896145 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:45.901687 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:45.901652 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" event={"ID":"42c15023-822d-48c9-9f1e-72c0f23a8bb6","Type":"ContainerStarted","Data":"6a9fd2a222f5f0582c290c53da693fdc8915d3e58541e2cd97003a10234b2969"} Jul 10 19:04:46.689557 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:46.689510 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:46.689809 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:46.689668 2567 patch_prober.go:28] interesting pod/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 10 19:04:46.689809 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:46.689718 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 10 19:04:47.689695 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:47.689654 2567 patch_prober.go:28] interesting pod/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 10 19:04:47.690169 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:47.689725 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 10 19:04:48.406598 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:48.406548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:48.689652 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:48.689621 2567 patch_prober.go:28] interesting pod/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 10 19:04:48.689808 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:48.689674 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 10 19:04:48.697271 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:48.697246 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:48.902216 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:48.902180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:48.999037 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:48.999002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:49.171821 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:49.171789 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:49.689257 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:49.689215 2567 patch_prober.go:28] interesting pod/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 10 19:04:49.689444 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:49.689286 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 10 19:04:50.693078 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:50.693051 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:50.693575 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:50.693337 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:50.694054 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:50.694034 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:04:50.883589 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:50.883547 2567 patch_prober.go:28] interesting pod/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 19:04:50.883767 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:50.883622 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 19:04:51.933008 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:51.932906 2567 generic.go:356] "Generic (PLEG): container finished" podID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerID="caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef" exitCode=0 Jul 10 19:04:51.933008 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:51.932986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" event={"ID":"046d5fcd-b9da-4505-a229-1b7f067b68db","Type":"ContainerDied","Data":"caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef"} Jul 10 19:04:51.933594 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:51.933567 2567 scope.go:117] "RemoveContainer" containerID="caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef" Jul 10 19:04:51.934540 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:51.934513 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:51.934647 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:51.934581 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:51.934647 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:51.934616 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:04:52.942771 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:52.942724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" event={"ID":"046d5fcd-b9da-4505-a229-1b7f067b68db","Type":"ContainerStarted","Data":"6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91"} Jul 10 19:04:53.228837 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:53.228796 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:53.229131 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:53.228851 2567 patch_prober.go:28] interesting pod/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 10 19:04:53.229324 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:53.229287 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 10 19:04:54.228554 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.228508 2567 patch_prober.go:28] interesting pod/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 10 19:04:54.229056 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.228583 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 10 19:04:54.549721 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.549553 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:54.665319 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.665279 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:54.756457 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.755953 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh"] Jul 10 19:04:54.756457 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.756220 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" containerID="cri-o://6a9fd2a222f5f0582c290c53da693fdc8915d3e58541e2cd97003a10234b2969" gracePeriod=30 Jul 10 19:04:54.768900 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.768872 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:54.985677 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:54.985627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:55.149451 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.149316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:55.228811 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.228762 2567 patch_prober.go:28] interesting pod/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 10 19:04:55.229294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.228836 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 10 19:04:55.520064 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.520034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:55.625246 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.625215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:55.723296 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.723266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:55.879839 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:55.879741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:56.228930 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:56.228895 2567 patch_prober.go:28] interesting pod/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 10 19:04:56.229571 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:56.229536 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 10 19:04:57.231914 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:57.231884 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:57.232356 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:57.232245 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:57.233078 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:57.233062 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:04:59.877189 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:59.877168 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:59.977959 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:59.977922 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:04:59.986732 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:59.986705 2567 generic.go:356] "Generic (PLEG): container finished" podID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerID="6a9fd2a222f5f0582c290c53da693fdc8915d3e58541e2cd97003a10234b2969" exitCode=0 Jul 10 19:04:59.986882 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:59.986750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" event={"ID":"42c15023-822d-48c9-9f1e-72c0f23a8bb6","Type":"ContainerDied","Data":"6a9fd2a222f5f0582c290c53da693fdc8915d3e58541e2cd97003a10234b2969"} Jul 10 19:04:59.986882 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:04:59.986801 2567 scope.go:117] "RemoveContainer" containerID="e29c55ee33a2df40752716b2b046ecf5c39c934bbf90473affadb0810c211496" Jul 10 19:05:00.018680 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.018631 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:05:00.114890 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.114854 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-token\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115080 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.114931 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istiod-ca-cert\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115080 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.114983 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-credential-socket\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115080 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115025 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-data\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115080 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115048 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-socket\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115080 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115073 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-podinfo\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115344 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115101 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xzfd\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-kube-api-access-9xzfd\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115344 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115178 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-certs\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115344 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115206 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-envoy\") pod \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\" (UID: \"42c15023-822d-48c9-9f1e-72c0f23a8bb6\") " Jul 10 19:05:00.115344 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115309 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:00.115586 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115408 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:00.115586 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115467 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:05:00.115691 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115615 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.115691 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115625 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:00.115691 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115636 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istiod-ca-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.115691 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.115650 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-credential-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.116069 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.116032 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:00.117336 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.117297 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-kube-api-access-9xzfd" (OuterVolumeSpecName: "kube-api-access-9xzfd") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "kube-api-access-9xzfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:05:00.117576 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.117557 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:05:00.117668 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.117616 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:00.117721 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.117670 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42c15023-822d-48c9-9f1e-72c0f23a8bb6" (UID: "42c15023-822d-48c9-9f1e-72c0f23a8bb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:05:00.216925 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.216870 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-workload-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.216925 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.216918 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-envoy\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.216925 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.216927 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-token\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.216925 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.216935 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-data\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.216925 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.216943 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42c15023-822d-48c9-9f1e-72c0f23a8bb6-istio-podinfo\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.217236 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.216952 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xzfd\" (UniqueName: \"kubernetes.io/projected/42c15023-822d-48c9-9f1e-72c0f23a8bb6-kube-api-access-9xzfd\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:00.998559 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.998516 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" event={"ID":"42c15023-822d-48c9-9f1e-72c0f23a8bb6","Type":"ContainerDied","Data":"f1cac3d71fa8abb259e50e64f00cee46df0734330d773430b911a358ec4d05c5"} Jul 10 19:05:00.998559 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.998546 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh" Jul 10 19:05:00.999037 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:00.998617 2567 scope.go:117] "RemoveContainer" containerID="6a9fd2a222f5f0582c290c53da693fdc8915d3e58541e2cd97003a10234b2969" Jul 10 19:05:01.021320 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.021295 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh"] Jul 10 19:05:01.024754 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.024722 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3870b4-openshift-default-555699bd47-pgfxh"] Jul 10 19:05:01.320414 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.320328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:01.421708 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.421668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:01.463150 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.463105 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" path="/var/lib/kubelet/pods/42c15023-822d-48c9-9f1e-72c0f23a8bb6/volumes" Jul 10 19:05:01.501496 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.501462 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d"] Jul 10 19:05:01.501728 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.501701 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" containerID="cri-o://6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91" gracePeriod=30 Jul 10 19:05:01.528232 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.528206 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:01.753151 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:01.753100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:02.054638 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.054550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:02.414102 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.414023 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx"] Jul 10 19:05:02.414372 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.414360 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" Jul 10 19:05:02.414423 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.414374 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" Jul 10 19:05:02.414498 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.414487 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" Jul 10 19:05:02.414537 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.414501 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" Jul 10 19:05:02.417700 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.417681 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.420240 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.420220 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-33ca20-openshift-default-dockercfg-969mj\"" Jul 10 19:05:02.423955 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.423931 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:02.449125 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.449091 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx"] Jul 10 19:05:02.537761 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-socket\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.537957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-credential-socket\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.537957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-token\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.537957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-envoy\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.537957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-data\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.537957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istiod-ca-cert\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.537957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.537958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrqn\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-kube-api-access-rtrqn\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.538194 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.538053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-certs\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.538194 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.538076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-podinfo\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639567 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-certs\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639567 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-podinfo\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-socket\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-credential-socket\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-token\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-envoy\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-data\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istiod-ca-cert\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.639820 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.639782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrqn\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-kube-api-access-rtrqn\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.640152 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.640002 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-socket\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.640152 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.640060 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-certs\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.640152 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.640083 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-data\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.640307 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.640217 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-credential-socket\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.640641 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.640620 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istiod-ca-cert\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.642199 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.642170 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-envoy\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.642308 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.642283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-podinfo\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.649685 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.649648 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-token\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.649792 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.649776 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrqn\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-kube-api-access-rtrqn\") pod \"e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.723996 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.723966 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:02.727931 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.727911 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:02.865811 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.865785 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx"] Jul 10 19:05:02.868406 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:05:02.868378 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2a92d7_68a8_4606_909f_cd4bfdec03c4.slice/crio-50c2a286ca6fcb120ea82220e92e68b3c01de8aa0f371f3d280bcd3714f08b21 WatchSource:0}: Error finding container 50c2a286ca6fcb120ea82220e92e68b3c01de8aa0f371f3d280bcd3714f08b21: Status 404 returned error can't find the container with id 50c2a286ca6fcb120ea82220e92e68b3c01de8aa0f371f3d280bcd3714f08b21 Jul 10 19:05:02.870587 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.870556 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:02.870692 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.870642 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:02.870756 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:02.870712 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:03.012694 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:03.012600 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" event={"ID":"2f2a92d7-68a8-4606-909f-cd4bfdec03c4","Type":"ContainerStarted","Data":"5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed"} Jul 10 19:05:03.012694 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:03.012661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" event={"ID":"2f2a92d7-68a8-4606-909f-cd4bfdec03c4","Type":"ContainerStarted","Data":"50c2a286ca6fcb120ea82220e92e68b3c01de8aa0f371f3d280bcd3714f08b21"} Jul 10 19:05:03.034304 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:03.034248 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podStartSLOduration=1.03422801 podStartE2EDuration="1.03422801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:03.033044571 +0000 UTC m=+2144.625516781" watchObservedRunningTime="2026-07-10 19:05:03.03422801 +0000 UTC m=+2144.626700220" Jul 10 19:05:03.728900 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:03.728863 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:03.734213 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:03.734185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:04.017895 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:04.017809 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:04.018723 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:04.018705 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:04.911885 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:04.911849 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:04.991288 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:04.991257 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:05.122660 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:05.122627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:05.306030 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:05.305992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:05.466364 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:05.466333 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:05.569118 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:05.569008 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:06.765071 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.765000 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:05:06.880578 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880543 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-token\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880578 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880580 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-podinfo\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880815 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880646 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-credential-socket\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880815 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880663 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2hsm\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-kube-api-access-q2hsm\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880815 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880678 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/046d5fcd-b9da-4505-a229-1b7f067b68db-istiod-ca-cert\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880815 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880712 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-envoy\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880815 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880746 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-certs\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.880815 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880783 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-socket\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.881130 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880825 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-data\") pod \"046d5fcd-b9da-4505-a229-1b7f067b68db\" (UID: \"046d5fcd-b9da-4505-a229-1b7f067b68db\") " Jul 10 19:05:06.881130 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.880987 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:06.881243 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.881165 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:06.881243 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.881191 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/046d5fcd-b9da-4505-a229-1b7f067b68db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:05:06.881243 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.881225 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-credential-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.881399 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.881345 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:06.881837 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.881809 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-data" (OuterVolumeSpecName: "istio-data") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:06.882890 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.882868 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-token" (OuterVolumeSpecName: "istio-token") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:05:06.882989 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.882971 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:05:06.883128 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.883107 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-kube-api-access-q2hsm" (OuterVolumeSpecName: "kube-api-access-q2hsm") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "kube-api-access-q2hsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:05:06.883190 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.883174 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "046d5fcd-b9da-4505-a229-1b7f067b68db" (UID: "046d5fcd-b9da-4505-a229-1b7f067b68db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:05:06.982784 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982749 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2hsm\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-kube-api-access-q2hsm\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.982784 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982781 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/046d5fcd-b9da-4505-a229-1b7f067b68db-istiod-ca-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.982784 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982792 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-envoy\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.983025 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982802 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.983025 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982816 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-workload-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.983025 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982826 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-data\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.983025 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982835 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-token\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:06.983025 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:06.982843 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/046d5fcd-b9da-4505-a229-1b7f067b68db-istio-podinfo\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:05:07.033044 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.032945 2567 generic.go:356] "Generic (PLEG): container finished" podID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerID="6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91" exitCode=0 Jul 10 19:05:07.033044 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.032991 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" Jul 10 19:05:07.033044 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.033021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" event={"ID":"046d5fcd-b9da-4505-a229-1b7f067b68db","Type":"ContainerDied","Data":"6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91"} Jul 10 19:05:07.033326 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.033074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d" event={"ID":"046d5fcd-b9da-4505-a229-1b7f067b68db","Type":"ContainerDied","Data":"6e505a5a37fb470814fafce510f2aeeca27786e50b2d507708d86ce3d7b4c311"} Jul 10 19:05:07.033326 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.033101 2567 scope.go:117] "RemoveContainer" containerID="6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91" Jul 10 19:05:07.042552 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.042530 2567 scope.go:117] "RemoveContainer" containerID="caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef" Jul 10 19:05:07.050185 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.050165 2567 scope.go:117] "RemoveContainer" containerID="6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91" Jul 10 19:05:07.050440 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:05:07.050400 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91\": container with ID starting with 6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91 not found: ID does not exist" containerID="6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91" Jul 10 19:05:07.050491 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.050451 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91"} err="failed to get container status \"6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91\": rpc error: code = NotFound desc = could not find container \"6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91\": container with ID starting with 6468b1ce940894b198b4af51e2392cf1a6955d129c6def6b7800ce2796578c91 not found: ID does not exist" Jul 10 19:05:07.050491 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.050470 2567 scope.go:117] "RemoveContainer" containerID="caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef" Jul 10 19:05:07.050672 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:05:07.050657 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef\": container with ID starting with caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef not found: ID does not exist" containerID="caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef" Jul 10 19:05:07.050710 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.050675 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef"} err="failed to get container status \"caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef\": rpc error: code = NotFound desc = could not find container \"caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef\": container with ID starting with caa3e7de50cc25713af3f2f6674f937279cfe8c0b85927fd0d64ec686796d1ef not found: ID does not exist" Jul 10 19:05:07.054464 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.054423 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d"] Jul 10 19:05:07.058473 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.058450 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ba3fa5-openshift-default-cf8bddbd5-s5x7d"] Jul 10 19:05:07.463130 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:07.463042 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" path="/var/lib/kubelet/pods/046d5fcd-b9da-4505-a229-1b7f067b68db/volumes" Jul 10 19:05:09.078576 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.078537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:09.177364 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.177332 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:09.380876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.380794 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:09.677407 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.677328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:09.935282 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935199 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc"] Jul 10 19:05:09.935727 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935713 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" Jul 10 19:05:09.935774 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935731 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42c15023-822d-48c9-9f1e-72c0f23a8bb6" containerName="istio-proxy" Jul 10 19:05:09.935774 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935762 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" Jul 10 19:05:09.935774 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935771 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" Jul 10 19:05:09.935870 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935781 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" Jul 10 19:05:09.935870 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935790 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" Jul 10 19:05:09.935929 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935875 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" Jul 10 19:05:09.935929 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.935886 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="046d5fcd-b9da-4505-a229-1b7f067b68db" containerName="istio-proxy" Jul 10 19:05:09.940407 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.940383 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:09.942801 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.942778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7b46a3-openshift-default-dockercfg-rzn4b\"" Jul 10 19:05:09.949252 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.949230 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc"] Jul 10 19:05:09.987252 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:09.987220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:10.110864 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.110834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-token\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.110887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-certs\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.110930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-podinfo\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.110971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0afe6729-9819-48f2-b15b-aac78e5690ee-istiod-ca-cert\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.111035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-socket\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.111061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-credential-socket\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.111097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-envoy\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.111118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnd2c\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-kube-api-access-wnd2c\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.111242 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.111158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-data\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212012 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.211923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-token\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212012 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.211979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-certs\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212012 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.211997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-podinfo\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0afe6729-9819-48f2-b15b-aac78e5690ee-istiod-ca-cert\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-socket\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-credential-socket\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-envoy\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnd2c\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-kube-api-access-wnd2c\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212294 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-data\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212625 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212420 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-certs\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212625 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212480 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-socket\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212625 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212566 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-data\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212625 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212571 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-credential-socket\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.212844 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.212827 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0afe6729-9819-48f2-b15b-aac78e5690ee-istiod-ca-cert\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.214513 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.214492 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-envoy\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.214634 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.214616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-podinfo\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.219835 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.219810 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-token\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.219939 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.219906 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnd2c\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-kube-api-access-wnd2c\") pod \"e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.251938 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.251903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:10.285745 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.285715 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:10.408456 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.405016 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc"] Jul 10 19:05:10.412559 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:05:10.412526 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afe6729_9819_48f2_b15b_aac78e5690ee.slice/crio-a7825cf01fba42719c093c070c4436f4dba2213bcc17668e9e4ae154758fd62c WatchSource:0}: Error finding container a7825cf01fba42719c093c070c4436f4dba2213bcc17668e9e4ae154758fd62c: Status 404 returned error can't find the container with id a7825cf01fba42719c093c070c4436f4dba2213bcc17668e9e4ae154758fd62c Jul 10 19:05:10.414515 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.414481 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:10.414629 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.414544 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:10.414629 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:10.414570 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:11.057819 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:11.057783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" event={"ID":"0afe6729-9819-48f2-b15b-aac78e5690ee","Type":"ContainerStarted","Data":"e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b"} Jul 10 19:05:11.058032 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:11.057837 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" event={"ID":"0afe6729-9819-48f2-b15b-aac78e5690ee","Type":"ContainerStarted","Data":"a7825cf01fba42719c093c070c4436f4dba2213bcc17668e9e4ae154758fd62c"} Jul 10 19:05:11.080472 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:11.080398 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podStartSLOduration=2.080382436 podStartE2EDuration="2.080382436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:11.078957403 +0000 UTC m=+2152.671429646" watchObservedRunningTime="2026-07-10 19:05:11.080382436 +0000 UTC m=+2152.672854643" Jul 10 19:05:11.252760 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:11.252651 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:11.258108 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:11.258080 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:12.063028 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:12.062987 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:12.064075 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:12.064052 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:12.941456 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:12.938391 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:13.001500 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:13.001459 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:13.205537 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:13.205449 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:13.457566 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:13.457481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:13.825626 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:13.825592 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:13.903699 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:13.903665 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:17.425322 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:17.425266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:18.094178 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:18.094146 2567 generic.go:356] "Generic (PLEG): container finished" podID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerID="5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed" exitCode=0 Jul 10 19:05:18.094453 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:18.094217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" event={"ID":"2f2a92d7-68a8-4606-909f-cd4bfdec03c4","Type":"ContainerDied","Data":"5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed"} Jul 10 19:05:18.094696 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:18.094660 2567 scope.go:117] "RemoveContainer" containerID="5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed" Jul 10 19:05:18.095632 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:18.095601 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:18.095742 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:18.095683 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:18.095742 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:18.095728 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:19.018029 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:19.017978 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:19.100147 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:19.100115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" event={"ID":"2f2a92d7-68a8-4606-909f-cd4bfdec03c4","Type":"ContainerStarted","Data":"6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f"} Jul 10 19:05:19.730020 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:19.729977 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:19.730223 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:19.730151 2567 patch_prober.go:28] interesting pod/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 19:05:19.730223 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:19.730200 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 19:05:20.735453 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:20.728852 2567 patch_prober.go:28] interesting pod/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 19:05:20.735453 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:20.728919 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 19:05:21.728601 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:21.728564 2567 patch_prober.go:28] interesting pod/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 19:05:21.728894 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:21.728856 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 19:05:22.729051 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:22.729004 2567 patch_prober.go:28] interesting pod/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 19:05:22.729584 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:22.729078 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 19:05:23.737807 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:23.737772 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:23.739043 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:23.739019 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:23.739948 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:23.739926 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:05:26.198236 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:26.198199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:26.300861 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:26.300829 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:28.103622 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:28.103572 2567 patch_prober.go:28] interesting pod/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 19:05:28.104023 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:28.103665 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 19:05:29.147209 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:29.147177 2567 generic.go:356] "Generic (PLEG): container finished" podID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerID="e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b" exitCode=0 Jul 10 19:05:29.147646 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:29.147257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" event={"ID":"0afe6729-9819-48f2-b15b-aac78e5690ee","Type":"ContainerDied","Data":"e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b"} Jul 10 19:05:29.147716 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:29.147680 2567 scope.go:117] "RemoveContainer" containerID="e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b" Jul 10 19:05:29.148787 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:29.148761 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:29.148857 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:29.148834 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:29.148894 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:29.148863 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 19:05:30.157469 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:30.157408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" event={"ID":"0afe6729-9819-48f2-b15b-aac78e5690ee","Type":"ContainerStarted","Data":"59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e"} Jul 10 19:05:30.252558 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:30.252513 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:30.252763 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:30.252739 2567 patch_prober.go:28] interesting pod/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 10 19:05:30.252842 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:30.252797 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 10 19:05:31.253244 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:31.253205 2567 patch_prober.go:28] interesting pod/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 10 19:05:31.253664 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:31.253270 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 10 19:05:32.252865 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:32.252829 2567 patch_prober.go:28] interesting pod/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 10 19:05:32.253052 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:32.252881 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 10 19:05:33.252785 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:33.252749 2567 patch_prober.go:28] interesting pod/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 10 19:05:33.253206 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:33.252809 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 10 19:05:34.256044 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:34.256015 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:34.256442 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:34.256356 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:34.257007 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:34.256988 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:05:35.627747 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:35.627713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:35.728849 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:35.728808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:54.090167 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:54.090129 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:05:57.802055 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:05:57.802024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:07:34.008343 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:07:34.008313 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:07:35.488855 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:07:35.488823 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:07:58.124831 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:07:58.124794 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:07:59.092102 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:07:59.092063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:08:00.176803 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:08:00.176770 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:08:25.529332 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:08:25.529244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:08:55.591739 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:08:55.591709 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:09:19.054373 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:19.054344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 19:09:19.056974 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:19.056950 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 19:09:19.062729 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:19.062707 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 19:09:19.064995 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:19.064978 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdh4c_a41e9adb-8a23-4289-acf8-4841155bd877/ovn-acl-logging/0.log" Jul 10 19:09:19.130186 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:19.130161 2567 scope.go:117] "RemoveContainer" containerID="4f6f98bf03f127701ea6e095417eada67c4443b20b8febbe2baa208a86766250" Jul 10 19:09:41.012183 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:41.012151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:09:41.923180 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:41.923147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:09:53.189236 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.189199 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn"] Jul 10 19:09:53.191663 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.191635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.194102 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.194080 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-33ca20\"/\"kube-root-ca.crt\"" Jul 10 19:09:53.195133 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.195108 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-33ca20\"/\"openshift-service-ca.crt\"" Jul 10 19:09:53.195245 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.195129 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-33ca20\"/\"default-dockercfg-wvv54\"" Jul 10 19:09:53.195245 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.195132 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-33ca20\"/\"rate-test-model-33ca20-kserve-self-signed-certs\"" Jul 10 19:09:53.203850 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.203832 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn"] Jul 10 19:09:53.219066 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.219041 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:09:53.359075 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.359036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-dshm\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.359575 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.359187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfrw\" (UniqueName: \"kubernetes.io/projected/5993a8d4-2a20-404a-9014-65ae2eda2520-kube-api-access-qtfrw\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.359575 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.359240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-tmp-dir\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.359575 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.359301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-model-cache\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.360750 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.360721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5993a8d4-2a20-404a-9014-65ae2eda2520-tls-certs\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.361040 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.361019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-home\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462501 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-tmp-dir\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462501 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-model-cache\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462726 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5993a8d4-2a20-404a-9014-65ae2eda2520-tls-certs\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462726 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-home\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462726 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-dshm\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462726 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfrw\" (UniqueName: \"kubernetes.io/projected/5993a8d4-2a20-404a-9014-65ae2eda2520-kube-api-access-qtfrw\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462933 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462726 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-tmp-dir\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462933 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462814 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-model-cache\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.462933 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.462871 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-home\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.464828 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.464810 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-dshm\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.465006 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.464989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5993a8d4-2a20-404a-9014-65ae2eda2520-tls-certs\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.470844 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.470819 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfrw\" (UniqueName: \"kubernetes.io/projected/5993a8d4-2a20-404a-9014-65ae2eda2520-kube-api-access-qtfrw\") pod \"rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.515184 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.515155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:09:53.643662 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:53.643632 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn"] Jul 10 19:09:53.647004 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:09:53.646976 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5993a8d4_2a20_404a_9014_65ae2eda2520.slice/crio-80be815903b110e260c899b22b705617a0f98d1b5bd4b3e741c3771f88dda5e5 WatchSource:0}: Error finding container 80be815903b110e260c899b22b705617a0f98d1b5bd4b3e741c3771f88dda5e5: Status 404 returned error can't find the container with id 80be815903b110e260c899b22b705617a0f98d1b5bd4b3e741c3771f88dda5e5 Jul 10 19:09:54.416989 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:54.416954 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" event={"ID":"5993a8d4-2a20-404a-9014-65ae2eda2520","Type":"ContainerStarted","Data":"298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907"} Jul 10 19:09:54.417362 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:54.417000 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" event={"ID":"5993a8d4-2a20-404a-9014-65ae2eda2520","Type":"ContainerStarted","Data":"80be815903b110e260c899b22b705617a0f98d1b5bd4b3e741c3771f88dda5e5"} Jul 10 19:09:54.433207 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:09:54.433137 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" podStartSLOduration=1.4331230719999999 podStartE2EDuration="1.433123072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:09:54.431079438 +0000 UTC m=+2436.023551647" watchObservedRunningTime="2026-07-10 19:09:54.433123072 +0000 UTC m=+2436.025595280" Jul 10 19:10:03.515861 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:03.515820 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:10:03.515861 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:03.515872 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:10:03.528635 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:03.528609 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:10:04.475438 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:04.475407 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:10:09.777570 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:09.777535 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:09.878731 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:09.878695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:23.593767 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:23.593732 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:26.911024 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:26.910984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:27.012636 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:27.012606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:27.623556 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:27.623523 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:36.494193 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:36.494151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:10:36.595162 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:10:36.595130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:10.075383 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:10.075346 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn"] Jul 10 19:11:10.094423 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:10.094349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:10.994560 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:10.994517 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:25.098095 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.098047 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" podUID="5993a8d4-2a20-404a-9014-65ae2eda2520" containerName="main" containerID="cri-o://298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907" gracePeriod=45 Jul 10 19:11:25.347785 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.347757 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:11:25.462671 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.462589 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-dshm\") pod \"5993a8d4-2a20-404a-9014-65ae2eda2520\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " Jul 10 19:11:25.462671 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.462654 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5993a8d4-2a20-404a-9014-65ae2eda2520-tls-certs\") pod \"5993a8d4-2a20-404a-9014-65ae2eda2520\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " Jul 10 19:11:25.462854 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.462790 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtfrw\" (UniqueName: \"kubernetes.io/projected/5993a8d4-2a20-404a-9014-65ae2eda2520-kube-api-access-qtfrw\") pod \"5993a8d4-2a20-404a-9014-65ae2eda2520\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " Jul 10 19:11:25.462912 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.462883 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-model-cache\") pod \"5993a8d4-2a20-404a-9014-65ae2eda2520\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " Jul 10 19:11:25.462974 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.462908 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-tmp-dir\") pod \"5993a8d4-2a20-404a-9014-65ae2eda2520\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " Jul 10 19:11:25.462974 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.462942 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-home\") pod \"5993a8d4-2a20-404a-9014-65ae2eda2520\" (UID: \"5993a8d4-2a20-404a-9014-65ae2eda2520\") " Jul 10 19:11:25.463206 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.463176 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-model-cache" (OuterVolumeSpecName: "model-cache") pod "5993a8d4-2a20-404a-9014-65ae2eda2520" (UID: "5993a8d4-2a20-404a-9014-65ae2eda2520"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:25.463343 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.463287 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-home" (OuterVolumeSpecName: "home") pod "5993a8d4-2a20-404a-9014-65ae2eda2520" (UID: "5993a8d4-2a20-404a-9014-65ae2eda2520"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:25.463343 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.463321 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-model-cache\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:25.463541 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.463358 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5993a8d4-2a20-404a-9014-65ae2eda2520" (UID: "5993a8d4-2a20-404a-9014-65ae2eda2520"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:25.464913 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.464882 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-dshm" (OuterVolumeSpecName: "dshm") pod "5993a8d4-2a20-404a-9014-65ae2eda2520" (UID: "5993a8d4-2a20-404a-9014-65ae2eda2520"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:25.465023 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.465003 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5993a8d4-2a20-404a-9014-65ae2eda2520-kube-api-access-qtfrw" (OuterVolumeSpecName: "kube-api-access-qtfrw") pod "5993a8d4-2a20-404a-9014-65ae2eda2520" (UID: "5993a8d4-2a20-404a-9014-65ae2eda2520"). InnerVolumeSpecName "kube-api-access-qtfrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:25.465131 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.465114 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5993a8d4-2a20-404a-9014-65ae2eda2520-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5993a8d4-2a20-404a-9014-65ae2eda2520" (UID: "5993a8d4-2a20-404a-9014-65ae2eda2520"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:11:25.563876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.563840 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-tmp-dir\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:25.563876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.563867 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-home\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:25.563876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.563876 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5993a8d4-2a20-404a-9014-65ae2eda2520-dshm\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:25.563876 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.563883 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5993a8d4-2a20-404a-9014-65ae2eda2520-tls-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:25.564171 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.563893 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtfrw\" (UniqueName: \"kubernetes.io/projected/5993a8d4-2a20-404a-9014-65ae2eda2520-kube-api-access-qtfrw\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:25.845244 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.845207 2567 generic.go:356] "Generic (PLEG): container finished" podID="5993a8d4-2a20-404a-9014-65ae2eda2520" containerID="298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907" exitCode=0 Jul 10 19:11:25.845244 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.845249 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" Jul 10 19:11:25.845505 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.845283 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" event={"ID":"5993a8d4-2a20-404a-9014-65ae2eda2520","Type":"ContainerDied","Data":"298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907"} Jul 10 19:11:25.845505 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.845327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn" event={"ID":"5993a8d4-2a20-404a-9014-65ae2eda2520","Type":"ContainerDied","Data":"80be815903b110e260c899b22b705617a0f98d1b5bd4b3e741c3771f88dda5e5"} Jul 10 19:11:25.845505 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.845349 2567 scope.go:117] "RemoveContainer" containerID="298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907" Jul 10 19:11:25.854630 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.854609 2567 scope.go:117] "RemoveContainer" containerID="298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907" Jul 10 19:11:25.854905 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:11:25.854885 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907\": container with ID starting with 298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907 not found: ID does not exist" containerID="298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907" Jul 10 19:11:25.854955 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.854915 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907"} err="failed to get container status \"298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907\": rpc error: code = NotFound desc = could not find container \"298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907\": container with ID starting with 298ee88f2392b1370a4605594c718a8233f5f7dbfde6217df2c4fd0f480c0907 not found: ID does not exist" Jul 10 19:11:25.866100 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.866076 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn"] Jul 10 19:11:25.869470 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:25.869447 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-33ca20/rate-test-model-33ca20-kserve-75bd6dd4c9-42nkn"] Jul 10 19:11:27.462594 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:27.462559 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5993a8d4-2a20-404a-9014-65ae2eda2520" path="/var/lib/kubelet/pods/5993a8d4-2a20-404a-9014-65ae2eda2520/volumes" Jul 10 19:11:29.884278 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:29.884238 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:30.328321 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:30.328285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:30.431059 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:30.431025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:30.530355 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:30.530322 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:30.668411 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:30.668327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:36.262411 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.262371 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:36.330154 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.330099 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:36.512684 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.512593 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx"] Jul 10 19:11:36.512904 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.512878 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" containerID="cri-o://6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f" gracePeriod=30 Jul 10 19:11:36.535077 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.535037 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:36.734991 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.734955 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:36.926267 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:36.926171 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:37.270007 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:37.269968 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:37.369892 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:37.369859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:37.470940 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:37.470906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:37.585219 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:37.585115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:38.740962 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:38.740928 2567 patch_prober.go:28] interesting pod/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 19:11:38.741355 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:38.741010 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 19:11:41.763180 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.763155 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:11:41.910147 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910073 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-token\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910147 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910114 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-credential-socket\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910147 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910143 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istiod-ca-cert\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910406 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910263 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-envoy\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910406 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910333 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-socket\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910406 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910355 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtrqn\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-kube-api-access-rtrqn\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910610 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910411 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-certs\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910610 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910421 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:41.910610 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910475 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-podinfo\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910610 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910506 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-data\") pod \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\" (UID: \"2f2a92d7-68a8-4606-909f-cd4bfdec03c4\") " Jul 10 19:11:41.910610 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910598 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:41.910872 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910639 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:11:41.910872 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910680 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:41.910872 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910852 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-credential-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:41.911031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910879 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istiod-ca-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:41.911031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910893 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:41.911031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.910904 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-workload-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:41.911465 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.911419 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:41.912680 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.912654 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:41.912761 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.912734 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-kube-api-access-rtrqn" (OuterVolumeSpecName: "kube-api-access-rtrqn") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "kube-api-access-rtrqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:41.912835 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.912813 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:41.912873 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.912821 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f2a92d7-68a8-4606-909f-cd4bfdec03c4" (UID: "2f2a92d7-68a8-4606-909f-cd4bfdec03c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:11:41.921796 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.921771 2567 generic.go:356] "Generic (PLEG): container finished" podID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerID="6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f" exitCode=0 Jul 10 19:11:41.921919 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.921815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" event={"ID":"2f2a92d7-68a8-4606-909f-cd4bfdec03c4","Type":"ContainerDied","Data":"6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f"} Jul 10 19:11:41.921919 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.921835 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" Jul 10 19:11:41.921919 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.921862 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx" event={"ID":"2f2a92d7-68a8-4606-909f-cd4bfdec03c4","Type":"ContainerDied","Data":"50c2a286ca6fcb120ea82220e92e68b3c01de8aa0f371f3d280bcd3714f08b21"} Jul 10 19:11:41.921919 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.921887 2567 scope.go:117] "RemoveContainer" containerID="6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f" Jul 10 19:11:41.932687 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.932667 2567 scope.go:117] "RemoveContainer" containerID="5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed" Jul 10 19:11:41.940331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.940314 2567 scope.go:117] "RemoveContainer" containerID="6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f" Jul 10 19:11:41.940587 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:11:41.940566 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f\": container with ID starting with 6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f not found: ID does not exist" containerID="6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f" Jul 10 19:11:41.940656 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.940592 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f"} err="failed to get container status \"6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f\": rpc error: code = NotFound desc = could not find container \"6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f\": container with ID starting with 6968b071e7a6d673769c6b22bd6b79e2de3f7d555bcfe8efb702dad7a914c86f not found: ID does not exist" Jul 10 19:11:41.940656 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.940610 2567 scope.go:117] "RemoveContainer" containerID="5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed" Jul 10 19:11:41.940824 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:11:41.940809 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed\": container with ID starting with 5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed not found: ID does not exist" containerID="5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed" Jul 10 19:11:41.940864 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.940827 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed"} err="failed to get container status \"5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed\": rpc error: code = NotFound desc = could not find container \"5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed\": container with ID starting with 5be92c84f1ef618a92a5c5ca99a676e32fd9f06cd1cf60c70d6473353792b5ed not found: ID does not exist" Jul 10 19:11:41.954055 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.954027 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx"] Jul 10 19:11:41.955535 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:41.955514 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-33ca20-openshift-default-6dfc9655f-ghqgx"] Jul 10 19:11:42.011912 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:42.011878 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-envoy\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:42.012031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:42.011928 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtrqn\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-kube-api-access-rtrqn\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:42.012031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:42.011940 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-podinfo\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:42.012031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:42.011950 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-data\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:42.012031 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:42.011959 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f2a92d7-68a8-4606-909f-cd4bfdec03c4-istio-token\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:43.192614 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.192577 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:43.292202 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.292171 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:43.432531 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.432499 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc"] Jul 10 19:11:43.432749 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.432725 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" containerID="cri-o://59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e" gracePeriod=30 Jul 10 19:11:43.454232 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.454124 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:43.463285 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.463255 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" path="/var/lib/kubelet/pods/2f2a92d7-68a8-4606-909f-cd4bfdec03c4/volumes" Jul 10 19:11:43.652251 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:43.652218 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:48.680957 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.680928 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:11:48.767148 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767106 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-envoy\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767167 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-token\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767189 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0afe6729-9819-48f2-b15b-aac78e5690ee-istiod-ca-cert\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767212 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-certs\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767248 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-socket\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767264 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-data\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767287 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-podinfo\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767331 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767326 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-credential-socket\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767737 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767359 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnd2c\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-kube-api-access-wnd2c\") pod \"0afe6729-9819-48f2-b15b-aac78e5690ee\" (UID: \"0afe6729-9819-48f2-b15b-aac78e5690ee\") " Jul 10 19:11:48.767737 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767551 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:48.767737 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767680 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.767737 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767566 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:48.767935 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767779 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:48.767935 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.767911 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afe6729-9819-48f2-b15b-aac78e5690ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:11:48.768279 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.768252 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:48.769617 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.769590 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:11:48.769857 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.769832 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:48.769968 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.769904 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-kube-api-access-wnd2c" (OuterVolumeSpecName: "kube-api-access-wnd2c") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "kube-api-access-wnd2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:11:48.770130 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.770108 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0afe6729-9819-48f2-b15b-aac78e5690ee" (UID: "0afe6729-9819-48f2-b15b-aac78e5690ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:11:48.868812 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868774 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-workload-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.868812 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868807 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-data\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.868812 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868816 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-podinfo\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.869043 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868824 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-credential-socket\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.869043 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868836 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnd2c\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-kube-api-access-wnd2c\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.869043 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868846 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-envoy\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.869043 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868854 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0afe6729-9819-48f2-b15b-aac78e5690ee-istio-token\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.869043 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.868861 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0afe6729-9819-48f2-b15b-aac78e5690ee-istiod-ca-cert\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Jul 10 19:11:48.957586 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.957551 2567 generic.go:356] "Generic (PLEG): container finished" podID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerID="59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e" exitCode=0 Jul 10 19:11:48.957753 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.957594 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" Jul 10 19:11:48.957753 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.957624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" event={"ID":"0afe6729-9819-48f2-b15b-aac78e5690ee","Type":"ContainerDied","Data":"59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e"} Jul 10 19:11:48.957753 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.957682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc" event={"ID":"0afe6729-9819-48f2-b15b-aac78e5690ee","Type":"ContainerDied","Data":"a7825cf01fba42719c093c070c4436f4dba2213bcc17668e9e4ae154758fd62c"} Jul 10 19:11:48.957753 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.957704 2567 scope.go:117] "RemoveContainer" containerID="59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e" Jul 10 19:11:48.966549 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.966534 2567 scope.go:117] "RemoveContainer" containerID="e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b" Jul 10 19:11:48.974478 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.974460 2567 scope.go:117] "RemoveContainer" containerID="59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e" Jul 10 19:11:48.974740 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:11:48.974718 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e\": container with ID starting with 59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e not found: ID does not exist" containerID="59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e" Jul 10 19:11:48.974801 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.974748 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e"} err="failed to get container status \"59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e\": rpc error: code = NotFound desc = could not find container \"59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e\": container with ID starting with 59bef2d9a31226c6a1ef051bef031399e9fda6b677a410cd8cdf08e8f50b061e not found: ID does not exist" Jul 10 19:11:48.974801 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.974765 2567 scope.go:117] "RemoveContainer" containerID="e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b" Jul 10 19:11:48.974990 ip-10-0-143-133 kubenswrapper[2567]: E0710 19:11:48.974973 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b\": container with ID starting with e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b not found: ID does not exist" containerID="e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b" Jul 10 19:11:48.975040 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.974996 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b"} err="failed to get container status \"e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b\": rpc error: code = NotFound desc = could not find container \"e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b\": container with ID starting with e9623d1ec65a5dcaa9533953efffb1b4362c9ac0f8c2b0c706094a70084f868b not found: ID does not exist" Jul 10 19:11:48.979093 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.979074 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc"] Jul 10 19:11:48.982670 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:48.982651 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7b46a3-openshift-default-5c4bd66f55-5g2xc"] Jul 10 19:11:49.220026 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:49.219949 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq_95459d45-8903-4cc5-b104-a62a3636c0f2/copy-manifests/0.log" Jul 10 19:11:49.226632 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:49.226609 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq_95459d45-8903-4cc5-b104-a62a3636c0f2/manager/0.log" Jul 10 19:11:49.462465 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:49.462419 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" path="/var/lib/kubelet/pods/0afe6729-9819-48f2-b15b-aac78e5690ee/volumes" Jul 10 19:11:51.786931 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:51.786898 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-l9fmr_d1f951c5-ac42-4eb5-b139-4996eed958cf/manager/0.log" Jul 10 19:11:52.253064 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:52.253037 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tj5j9_328127a4-5112-4c69-8cee-4e4aff22d2cb/discovery/0.log" Jul 10 19:11:52.705819 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:52.705748 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9dhvv_44c8e161-ee65-4de4-9432-2090a7f9e55c/payload-pre-processing/0.log" Jul 10 19:11:52.923016 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:52.922983 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bfb77584-jqn6f_28295818-cd5d-4af1-a94a-518ea8991c49/router/0.log" Jul 10 19:11:53.254649 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:53.254619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wz5lw_b6b57d11-d147-4ae5-a462-fbaec4fdeef7/main/0.log" Jul 10 19:11:53.597122 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:53.597038 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb2r66_489a17fb-83df-4e65-b5d5-78d4d45c89c9/main/0.log" Jul 10 19:11:57.219218 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:57.219187 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:11:57.312714 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:11:57.312681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:12:00.138602 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:00.138568 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9fvjv_cbcbf77e-1c00-4010-bdb1-f1a7f79255cb/global-pull-secret-syncer/0.log" Jul 10 19:12:00.266704 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:00.266677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" Jul 10 19:12:00.405457 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:00.405360 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-133.ec2.internal_69999537d9fb87b3192608c1c39c2f51/haproxy/0.log" Jul 10 19:12:04.207297 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:04.207255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:12:04.268241 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:04.268207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42vpq_8180ebf3-abdd-40c2-a59a-131a23061c5b/konnectivity-agent/0.log" limit=1024 Jul 10 19:12:05.989442 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:05.989405 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-l9fmr_d1f951c5-ac42-4eb5-b139-4996eed958cf/manager/0.log" Jul 10 19:12:07.966608 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:07.966578 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-z4znq_24e11806-feda-477a-bb30-4e2edded4542/cluster-monitoring-operator/0.log" Jul 10 19:12:08.117532 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:08.117504 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcvkb_2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a/node-exporter/0.log" Jul 10 19:12:08.137913 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:08.137886 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcvkb_2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a/kube-rbac-proxy/0.log" Jul 10 19:12:08.157646 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:08.157620 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcvkb_2f0f4e91-1bc3-4aaa-84c2-5ad24e88786a/init-textfile/0.log" Jul 10 19:12:08.652304 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:08.652277 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-vzshl_861e7816-c6ac-494d-9a2a-b4cc67a739e9/prometheus-operator-admission-webhook/0.log" Jul 10 19:12:09.976727 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.976695 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs"] Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977027 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977038 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977049 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5993a8d4-2a20-404a-9014-65ae2eda2520" containerName="main" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977055 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5993a8d4-2a20-404a-9014-65ae2eda2520" containerName="main" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977068 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977074 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977080 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977085 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977137 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" Jul 10 19:12:09.977142 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977146 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afe6729-9819-48f2-b15b-aac78e5690ee" containerName="istio-proxy" Jul 10 19:12:09.977519 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977152 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2a92d7-68a8-4606-909f-cd4bfdec03c4" containerName="istio-proxy" Jul 10 19:12:09.977519 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.977159 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5993a8d4-2a20-404a-9014-65ae2eda2520" containerName="main" Jul 10 19:12:09.979179 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.979154 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:09.981736 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.981714 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9pq4\"/\"default-dockercfg-spgnv\"" Jul 10 19:12:09.981736 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.981731 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9pq4\"/\"kube-root-ca.crt\"" Jul 10 19:12:09.982361 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.982347 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9pq4\"/\"openshift-service-ca.crt\"" Jul 10 19:12:09.989774 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:09.989749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs"] Jul 10 19:12:10.009524 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.009477 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-jjltm_1c15740a-984f-4a75-83b3-2b74c94297de/networking-console-plugin/0.log" Jul 10 19:12:10.047654 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.047614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-sys\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.047831 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.047677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-podres\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.047831 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.047754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-lib-modules\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.047831 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.047795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rvv\" (UniqueName: \"kubernetes.io/projected/922178aa-8838-455f-a3b1-8d4c86508bb5-kube-api-access-59rvv\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.047958 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.047896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-proc\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.148901 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.148860 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-sys\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.148901 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.148909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-podres\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149002 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-sys\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-lib-modules\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rvv\" (UniqueName: \"kubernetes.io/projected/922178aa-8838-455f-a3b1-8d4c86508bb5-kube-api-access-59rvv\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-proc\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149139 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-podres\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149164 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149152 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-lib-modules\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.149396 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.149224 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/922178aa-8838-455f-a3b1-8d4c86508bb5-proc\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.157136 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.157114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rvv\" (UniqueName: \"kubernetes.io/projected/922178aa-8838-455f-a3b1-8d4c86508bb5-kube-api-access-59rvv\") pod \"perf-node-gather-daemonset-nclgs\" (UID: \"922178aa-8838-455f-a3b1-8d4c86508bb5\") " pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.289261 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.289171 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:10.429273 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.429247 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs"] Jul 10 19:12:10.431217 ip-10-0-143-133 kubenswrapper[2567]: W0710 19:12:10.431183 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod922178aa_8838_455f_a3b1_8d4c86508bb5.slice/crio-93ee47587e884a1cf1de8f3fb64d778018035a732ada2805c428f283b48bb58e WatchSource:0}: Error finding container 93ee47587e884a1cf1de8f3fb64d778018035a732ada2805c428f283b48bb58e: Status 404 returned error can't find the container with id 93ee47587e884a1cf1de8f3fb64d778018035a732ada2805c428f283b48bb58e Jul 10 19:12:10.690693 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.690615 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/1.log" Jul 10 19:12:10.696985 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:10.696966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5bglq_ce0239d7-8179-4d2c-968a-d61fd989d314/console-operator/2.log" Jul 10 19:12:11.056852 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.056814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" event={"ID":"922178aa-8838-455f-a3b1-8d4c86508bb5","Type":"ContainerStarted","Data":"a16e7d828f4c8701b69c8193ec2fba00aa3c7787f440d5efe895a7c97fc8a3dd"} Jul 10 19:12:11.057286 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.056866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" event={"ID":"922178aa-8838-455f-a3b1-8d4c86508bb5","Type":"ContainerStarted","Data":"93ee47587e884a1cf1de8f3fb64d778018035a732ada2805c428f283b48bb58e"} Jul 10 19:12:11.057286 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.056961 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:11.073910 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.073862 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" podStartSLOduration=2.073847138 podStartE2EDuration="2.073847138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:12:11.071880315 +0000 UTC m=+2572.664352544" watchObservedRunningTime="2026-07-10 19:12:11.073847138 +0000 UTC m=+2572.666319345" Jul 10 19:12:11.205539 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.205501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85c48ff4bc-vlb6j_ec2e6c0b-5c18-4aa5-889b-49eec6896ede/console/0.log" Jul 10 19:12:11.239034 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.239008 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-m2t7r_93c7a868-bc55-4782-a3f5-051b1075d396/download-server/0.log" Jul 10 19:12:11.787476 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:11.787443 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-dq4v6_2c8b5881-e7c9-45f0-a0ca-38879d8e6800/volume-data-source-validator/0.log" Jul 10 19:12:12.878356 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:12.878324 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wq99l_4efbf632-c810-4b02-83e6-44a901c22bb2/dns/0.log" Jul 10 19:12:12.901698 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:12.901670 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wq99l_4efbf632-c810-4b02-83e6-44a901c22bb2/kube-rbac-proxy/0.log" Jul 10 19:12:12.924759 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:12.924734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-775vg_748594fb-7124-496f-b49d-b7590bc1a75a/dns-node-resolver/0.log" Jul 10 19:12:13.517304 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:13.517272 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cd7848d87-vqmf8_a7528e3d-a4af-4263-a33e-a4d3e7dd8442/registry/0.log" Jul 10 19:12:13.584818 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:13.584789 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hw782_359c8127-f4c8-4d54-a384-844306262bc8/node-ca/0.log" Jul 10 19:12:14.575047 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:14.575014 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tj5j9_328127a4-5112-4c69-8cee-4e4aff22d2cb/discovery/0.log" Jul 10 19:12:14.749296 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:14.749266 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9dhvv_44c8e161-ee65-4de4-9432-2090a7f9e55c/payload-pre-processing/0.log" Jul 10 19:12:14.809197 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:14.809168 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bfb77584-jqn6f_28295818-cd5d-4af1-a94a-518ea8991c49/router/0.log" Jul 10 19:12:15.621293 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:15.621262 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrmhh_18d6dc42-b9e4-4ed2-aa48-c4f6ab72b38f/serve-healthcheck-canary/0.log" Jul 10 19:12:16.158790 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:16.158753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-fl9nz_e0c1fa28-c2f5-46f7-a69f-6d14b47dde88/insights-operator/0.log" Jul 10 19:12:16.160300 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:16.160279 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-fl9nz_e0c1fa28-c2f5-46f7-a69f-6d14b47dde88/insights-operator/1.log" Jul 10 19:12:16.190524 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:16.190502 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx56t_13bf96a9-2334-45f2-b2f1-52bfc29af22d/kube-rbac-proxy/0.log" Jul 10 19:12:16.239727 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:16.239699 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx56t_13bf96a9-2334-45f2-b2f1-52bfc29af22d/exporter/0.log" Jul 10 19:12:16.271302 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:16.271279 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lx56t_13bf96a9-2334-45f2-b2f1-52bfc29af22d/extractor/0.log" Jul 10 19:12:17.071464 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:17.071416 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9pq4/perf-node-gather-daemonset-nclgs" Jul 10 19:12:19.478883 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:19.478859 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq_95459d45-8903-4cc5-b104-a62a3636c0f2/manager/0.log" Jul 10 19:12:19.500381 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:19.500353 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d4bb5bfc9-hlksq_95459d45-8903-4cc5-b104-a62a3636c0f2/copy-manifests/0.log" Jul 10 19:12:20.672828 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:20.672794 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tj5j9_328127a4-5112-4c69-8cee-4e4aff22d2cb/discovery/0.log" Jul 10 19:12:20.805541 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:20.805515 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9dhvv_44c8e161-ee65-4de4-9432-2090a7f9e55c/payload-pre-processing/0.log" Jul 10 19:12:20.850611 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:20.850579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c6cfb7f55-5phwp_2f9b02d4-d7d4-4003-8ee3-d9c91748dc0f/manager/0.log" Jul 10 19:12:20.851734 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:20.851715 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bfb77584-jqn6f_28295818-cd5d-4af1-a94a-518ea8991c49/router/0.log" Jul 10 19:12:22.206702 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:22.206669 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tj5j9_328127a4-5112-4c69-8cee-4e4aff22d2cb/discovery/0.log" Jul 10 19:12:22.346832 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:22.346801 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9dhvv_44c8e161-ee65-4de4-9432-2090a7f9e55c/payload-pre-processing/0.log" Jul 10 19:12:22.390541 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:22.390513 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bfb77584-jqn6f_28295818-cd5d-4af1-a94a-518ea8991c49/router/0.log" Jul 10 19:12:25.779826 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:25.779799 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8pvxc_4db8b84b-614a-4082-92ab-0c5d702a2200/migrator/0.log" Jul 10 19:12:25.818371 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:25.818342 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8pvxc_4db8b84b-614a-4082-92ab-0c5d702a2200/graceful-termination/0.log" Jul 10 19:12:26.166162 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:26.166053 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8hkxs_fdfb69da-cc9b-4141-9feb-d6b1459d7b92/kube-storage-version-migrator-operator/1.log" Jul 10 19:12:26.166974 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:26.166953 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8hkxs_fdfb69da-cc9b-4141-9feb-d6b1459d7b92/kube-storage-version-migrator-operator/0.log" Jul 10 19:12:27.115735 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:27.115709 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5qkml_694767dd-6fd6-4131-a76a-9b84d1fc2f28/kube-multus/0.log" Jul 10 19:12:27.450184 ip-10-0-143-133 kubenswrapper[2567]: I0710 19:12:27.450097 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nktf9_48a27935-e769-4e7e-ab12-4553871d3d8b/kube-multus-additional-cni-plugins/0.log"