Jul 31 14:47:58.426207 ip-10-0-136-197 systemd[1]: Starting Kubernetes Kubelet... Jul 31 14:47:58.821883 ip-10-0-136-197 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:58.821883 ip-10-0-136-197 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 14:47:58.821883 ip-10-0-136-197 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:58.821883 ip-10-0-136-197 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 14:47:58.821883 ip-10-0-136-197 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:58.822550 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.821954 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 14:47:58.825447 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825431 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:58.825447 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825447 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825451 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825454 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825458 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825461 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825464 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825467 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825470 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825474 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825479 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825482 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825485 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825488 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825492 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825494 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825497 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825500 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825503 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825506 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:58.825512 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825509 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825512 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825515 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825517 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825520 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825523 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825526 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825528 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825531 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825533 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825536 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825538 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825541 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825544 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825546 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825549 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825551 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825554 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825556 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825559 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:58.826008 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825562 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825564 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825567 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825569 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825572 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825574 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825577 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825579 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825582 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825584 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825587 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825590 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825593 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825595 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825598 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825600 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825603 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825605 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825608 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:58.826485 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825610 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825613 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825616 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825619 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825621 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825624 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825626 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825629 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825631 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825635 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825639 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825642 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825645 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825647 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825650 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825653 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825655 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825658 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825660 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:58.826975 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825664 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825666 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825669 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825671 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825675 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825677 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825680 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825682 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825685 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825687 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825690 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825692 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825694 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825697 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825700 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825702 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825704 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825707 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825710 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825712 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:58.827437 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.825715 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826428 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826436 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826440 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826444 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826446 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826450 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826452 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826455 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826459 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826463 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826465 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826468 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826470 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826473 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826476 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826478 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826481 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826484 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:58.827942 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826487 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826490 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826492 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826495 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826497 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826500 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826503 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826505 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826508 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826511 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826513 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826516 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826518 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826521 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826524 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826527 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826530 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826533 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826535 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826538 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826548 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:58.828442 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826550 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826553 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826555 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826558 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826560 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826563 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826565 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826568 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826571 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826573 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826576 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826578 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826581 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826583 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826586 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826589 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826591 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826593 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826596 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:58.828958 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826598 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826601 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826604 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826606 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826608 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826611 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826614 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826616 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826619 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826623 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826626 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826629 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826631 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826637 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826640 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826643 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826645 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826648 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826651 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:58.829409 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826653 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826655 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826658 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826660 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826664 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826667 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826669 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826671 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826674 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826677 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826680 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826683 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826686 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826689 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826691 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826694 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826697 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826701 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826703 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826706 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:58.829868 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826708 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.826711 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827108 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827113 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827116 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827119 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827124 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827127 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827130 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827133 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827136 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827139 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827141 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827144 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827148 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827151 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827153 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827156 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827159 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:58.830356 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827161 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827164 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827166 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827169 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827172 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827174 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827177 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827179 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827181 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827184 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827187 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827190 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827192 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827195 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827198 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827202 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827205 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827208 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827211 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:58.830823 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827215 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827219 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827221 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827224 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827227 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827230 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827232 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827235 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827239 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827242 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827244 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827247 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827250 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827252 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827255 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827258 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827261 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827264 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827266 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827269 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:58.831302 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827271 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827274 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827276 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827279 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827281 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827284 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827286 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827290 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827292 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827295 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827297 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827300 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827302 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827304 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827307 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827310 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827312 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827315 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827317 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827320 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:58.831773 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827324 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827326 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827329 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827331 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827334 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827337 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827340 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827342 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827345 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827347 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827350 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827352 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827355 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827357 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827360 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827362 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827365 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827367 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827370 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827372 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:58.832269 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827374 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827377 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.827379 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827456 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827467 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827482 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827488 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827495 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827499 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827503 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827507 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827510 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827514 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827517 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827520 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827523 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827526 2579 flags.go:64] FLAG: --cgroup-root="" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827528 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827531 2579 flags.go:64] FLAG: --client-ca-file="" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827534 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827537 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827541 2579 flags.go:64] FLAG: --cluster-domain="" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827544 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827547 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 14:47:58.832752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827549 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827553 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827556 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827559 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827562 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827565 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827567 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827570 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827573 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827576 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827578 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827582 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827585 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827588 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827590 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827593 2579 flags.go:64] FLAG: --enable-server="true" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827596 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827600 2579 flags.go:64] FLAG: --event-burst="100" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827603 2579 flags.go:64] FLAG: --event-qps="50" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827605 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827608 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827611 2579 flags.go:64] FLAG: --eviction-hard="" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827617 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827620 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827623 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 14:47:58.833337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827625 2579 flags.go:64] FLAG: --eviction-soft="" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827628 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827633 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827637 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827639 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827642 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827645 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827648 2579 flags.go:64] FLAG: --feature-gates="" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827651 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827654 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827657 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827660 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827663 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827666 2579 flags.go:64] FLAG: --help="false" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827668 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-197.ec2.internal" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827671 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827674 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827677 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827680 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827683 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827686 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827688 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827691 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 14:47:58.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827693 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827697 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827700 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827703 2579 flags.go:64] FLAG: --kube-reserved="" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827706 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827708 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827711 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827714 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827716 2579 flags.go:64] FLAG: --lock-file="" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827719 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827722 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827725 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827731 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827733 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827736 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827739 2579 flags.go:64] FLAG: --logging-format="text" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827741 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827745 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827747 2579 flags.go:64] FLAG: --manifest-url="" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827750 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827754 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827757 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827761 2579 flags.go:64] FLAG: --max-pods="110" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827764 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827766 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 14:47:58.834534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827769 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827772 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827775 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827777 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827780 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827788 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827790 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827793 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827796 2579 flags.go:64] FLAG: --pod-cidr="" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827800 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827805 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827807 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827810 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827813 2579 flags.go:64] FLAG: --port="10250" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827816 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827818 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04aaa71f68631de9c" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827821 2579 flags.go:64] FLAG: --qos-reserved="" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827824 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827828 2579 flags.go:64] FLAG: --register-node="true" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827830 2579 flags.go:64] FLAG: --register-with-taints="" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827834 2579 flags.go:64] FLAG: --registry-burst="10" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827836 2579 flags.go:64] FLAG: --registry-qps="5" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827839 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827841 2579 flags.go:64] FLAG: --reserved-memory="" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827845 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 14:47:58.835151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827848 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827851 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827853 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827856 2579 flags.go:64] FLAG: --runonce="false" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827859 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827862 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827864 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827867 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827869 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827872 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827875 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827878 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827880 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827884 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827887 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827890 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827893 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827898 2579 flags.go:64] FLAG: --system-cgroups="" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827901 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827906 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827909 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827912 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827915 2579 flags.go:64] FLAG: --tls-min-version="" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827918 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827920 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 14:47:58.835745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827924 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827927 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827943 2579 flags.go:64] FLAG: --v="2" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827947 2579 flags.go:64] FLAG: --version="false" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827951 2579 flags.go:64] FLAG: --vmodule="" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827955 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.827958 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828084 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828088 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828092 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828094 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828097 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828101 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828105 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828108 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828111 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828114 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828116 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828119 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828121 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828126 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:58.836345 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828129 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828131 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828134 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828136 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828139 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828142 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828145 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828147 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828149 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828152 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828154 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828158 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828161 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828164 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828166 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828169 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828171 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828173 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828176 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828178 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:58.836867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828181 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828183 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828185 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828188 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828190 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828193 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828196 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828198 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828201 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828203 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828206 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828209 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828212 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828214 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828217 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828219 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828222 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828225 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828227 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828229 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:58.837448 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828232 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828235 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828237 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828240 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828243 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828245 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828248 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828250 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828253 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828255 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828258 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828260 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828263 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828265 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828268 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828270 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828272 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828275 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828278 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:58.838075 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828280 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828282 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828285 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828287 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828292 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828295 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828297 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828300 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828302 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828305 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828307 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828310 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828312 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828315 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828317 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828320 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828323 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828326 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828328 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:58.838541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828331 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828333 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828336 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828339 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828342 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828345 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.828348 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.828785 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.835333 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.835347 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.836011 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.836019 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836075 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836080 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:58.839104 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836084 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836087 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836090 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836096 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836099 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836101 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836104 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836107 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836110 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836112 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836116 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836118 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836121 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836123 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836126 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836128 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836131 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836134 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:58.839451 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836136 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836138 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836141 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836143 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836146 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836149 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836151 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836158 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836160 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836163 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836166 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836168 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836171 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836173 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836176 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836178 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836180 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836183 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836185 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:58.839895 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836188 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836190 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836193 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836195 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836198 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836200 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836203 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836205 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836208 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836211 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836215 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836218 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836221 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836224 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836226 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836229 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836231 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836234 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836236 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:58.840401 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836239 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836242 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836245 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836248 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836250 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836253 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836255 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836258 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836260 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836262 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836265 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836267 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836270 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836272 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836275 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836278 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836280 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836283 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836286 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836288 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:58.840867 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836291 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836293 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836296 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836299 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836302 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836306 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836309 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836312 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836315 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836317 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836320 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836322 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836325 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836328 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836332 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836336 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836339 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836342 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:58.841392 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836344 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.836349 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836484 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836489 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836492 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836495 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836498 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836501 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836504 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836507 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836509 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836512 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836514 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836517 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836519 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:58.841836 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836521 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836524 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836527 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836529 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836531 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836534 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836536 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836539 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836541 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836544 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836546 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836550 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836552 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836555 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836558 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836561 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836563 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836566 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836568 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836571 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:58.842222 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836573 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836576 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836578 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836581 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836583 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836585 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836588 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836590 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836593 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836595 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836597 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836600 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836602 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836604 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836608 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836612 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836615 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836618 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836620 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:58.842710 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836623 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836625 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836628 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836630 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836633 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836636 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836639 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836641 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836644 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836648 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836650 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836653 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836655 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836657 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836660 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836662 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836665 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836667 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836670 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:58.843288 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836672 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836675 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836677 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836680 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836684 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836686 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836689 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836692 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836695 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836698 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836700 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836703 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836705 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836707 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836710 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836712 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836715 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836717 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836720 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:58.843741 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836722 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836725 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836727 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836730 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836733 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836735 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836737 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836740 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:47:58.836742 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.836746 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.838033 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.840031 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.841288 2579 server.go:1019] "Starting client certificate rotation" Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.841380 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:47:58.844205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.841415 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:47:58.844537 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.844404 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:47:58.846304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.846290 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:47:58.855333 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.855313 2579 log.go:25] "Validated CRI v1 runtime API" Jul 31 14:47:58.857645 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.857627 2579 log.go:25] "Validated CRI v1 image API" Jul 31 14:47:58.858484 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.858469 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 14:47:58.864215 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.864181 2579 fs.go:135] Filesystem UUIDs: map[4ddb9e5a-5c28-4eee-a4d8-11bd2538e291:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 81957dd4-2d99-427b-bd76-25a0afbe63f5:/dev/nvme0n1p3] Jul 31 14:47:58.864307 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.864213 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 14:47:58.869705 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.869594 2579 manager.go:216] Machine: {Timestamp:2026-07-31 14:47:58.868093237 +0000 UTC m=+0.327706607 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096586 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23969f994abf5bde24a3864caebf34 SystemUUID:ec23969f-994a-bf5b-de24-a3864caebf34 BootID:8da81feb-6670-4f33-b625-d90b3dd7a432 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:15:c7:77:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:15:c7:77:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:71:4e:22:1b:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 14:47:58.869705 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.869695 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 14:47:58.869865 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.869799 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 14:47:58.870643 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.870629 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:47:58.870883 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.870856 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 14:47:58.871026 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.870889 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 14:47:58.871472 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.871463 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 14:47:58.871509 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.871474 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 14:47:58.871509 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.871481 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:47:58.872924 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.872912 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:47:58.873665 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.873655 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 14:47:58.876512 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876500 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:47:58.876625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876615 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 14:47:58.876665 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876644 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 31 14:47:58.876665 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876654 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 14:47:58.876733 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876666 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 14:47:58.876733 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876675 2579 kubelet.go:398] "Adding apiserver pod source" Jul 31 14:47:58.876733 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.876683 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 14:47:58.877093 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.877081 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:47:58.877132 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.877100 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:47:58.879965 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.879948 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 14:47:58.881344 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.881330 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 14:47:58.881410 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.881359 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 14:47:58.882361 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882349 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 14:47:58.882402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882369 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 14:47:58.882402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882378 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 14:47:58.882402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882383 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 14:47:58.882402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882393 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 14:47:58.882402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882399 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 14:47:58.882543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882407 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 14:47:58.882543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882412 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 14:47:58.882543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882421 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 14:47:58.882543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882429 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 14:47:58.882543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882439 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 14:47:58.882543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.882445 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 14:47:58.883672 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.883661 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 14:47:58.883728 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.883673 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 14:47:58.885839 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.885821 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 14:47:58.885926 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.885880 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 14:47:58.885990 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.885908 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 14:47:58.886921 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.886909 2579 server.go:1268] "Started kubelet" Jul 31 14:47:58.887195 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.887002 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 14:47:58.887195 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.887024 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 14:47:58.887195 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.887094 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 14:47:58.887726 ip-10-0-136-197 systemd[1]: Started Kubernetes Kubelet. Jul 31 14:47:58.888324 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.888204 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 14:47:58.888324 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.888229 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 31 14:47:58.891315 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.891292 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 14:47:58.894267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.894248 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 14:47:58.894267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.894257 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 14:47:58.894407 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.894391 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:58.894814 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.894798 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 14:47:58.895124 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.894886 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 14:47:58.895256 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.895244 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 14:47:58.895374 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.895178 2579 factory.go:55] Registering systemd factory Jul 31 14:47:58.895482 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.895382 2579 factory.go:223] Registration of the systemd container factory successfully Jul 31 14:47:58.895482 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.895423 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 31 14:47:58.895482 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.895433 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 31 14:47:58.895985 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.895966 2579 factory.go:153] Registering CRI-O factory Jul 31 14:47:58.896094 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.896083 2579 factory.go:223] Registration of the crio container factory successfully Jul 31 14:47:58.896225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.896216 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 14:47:58.896335 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.896326 2579 factory.go:103] Registering Raw factory Jul 31 14:47:58.896415 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.896408 2579 manager.go:1196] Started watching for new ooms in manager Jul 31 14:47:58.897129 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.897111 2579 manager.go:349] Starting recovery of all containers Jul 31 14:47:58.898767 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.898740 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 14:47:58.898857 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.898814 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 14:47:58.898911 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.897733 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-197.ec2.internal.18c7673aa73761b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-197.ec2.internal,UID:ip-10-0-136-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-197.ec2.internal,},FirstTimestamp:2026-07-31 14:47:58.886879666 +0000 UTC m=+0.346493035,LastTimestamp:2026-07-31 14:47:58.886879666 +0000 UTC m=+0.346493035,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-197.ec2.internal,}" Jul 31 14:47:58.900168 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.900087 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jjfzp" Jul 31 14:47:58.908386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.908370 2579 manager.go:354] Recovery completed Jul 31 14:47:58.909891 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.909759 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jjfzp" Jul 31 14:47:58.912686 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.912673 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:58.914470 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914456 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:58.914527 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914485 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:58.914527 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914499 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:58.914973 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914958 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 14:47:58.914973 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914971 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 14:47:58.915088 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914971 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:58.915088 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.914986 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:47:58.915667 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.915654 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:58.915725 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.915684 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:58.915725 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.915696 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:58.916174 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.916164 2579 policy_none.go:49] "None policy: Start" Jul 31 14:47:58.916206 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.916179 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 14:47:58.916206 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.916188 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 14:47:58.916868 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.916811 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-197.ec2.internal.18c7673aa8dc607b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-197.ec2.internal,UID:ip-10-0-136-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-197.ec2.internal,},FirstTimestamp:2026-07-31 14:47:58.914470011 +0000 UTC m=+0.374083383,LastTimestamp:2026-07-31 14:47:58.914470011 +0000 UTC m=+0.374083383,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-197.ec2.internal,}" Jul 31 14:47:58.917192 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.917177 2579 policy_none.go:47] "Start" Jul 31 14:47:58.956578 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.956562 2579 manager.go:337] "Starting Device Plugin manager" Jul 31 14:47:58.956663 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.956600 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 14:47:58.956663 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.956613 2579 server.go:87] "Starting device plugin registration server" Jul 31 14:47:58.956830 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.956820 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 14:47:58.956859 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.956831 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 14:47:58.956981 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.956961 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 14:47:58.957063 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.957043 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 14:47:58.957063 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:58.957053 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 14:47:58.957526 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.957497 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 14:47:58.957598 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:58.957564 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.035319 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.035297 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 14:47:59.037416 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.036558 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 14:47:59.037416 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.036590 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 14:47:59.037416 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.036611 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 14:47:59.037416 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.036641 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 14:47:59.040345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.040325 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:59.057362 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.057341 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:59.058112 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.058097 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:59.058203 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.058128 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:59.058203 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.058143 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:59.058203 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.058168 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.066930 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.066909 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.067013 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.066949 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-197.ec2.internal\": node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.099107 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.099061 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.137194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.137161 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal"] Jul 31 14:47:59.137265 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.137225 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:59.138491 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.138474 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:59.138577 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.138508 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:59.138577 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.138522 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:59.140726 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.140710 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:59.140888 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.140874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.140952 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.140901 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:59.141327 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.141310 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:59.141386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.141337 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:59.141386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.141340 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:59.141386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.141351 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:59.141386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.141357 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:59.141386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.141370 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:59.143612 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.143595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.143695 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.143622 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:59.144320 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.144299 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:59.144438 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.144334 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:59.144438 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.144354 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:59.163536 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.163516 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-197.ec2.internal\" not found" node="ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.167900 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.167886 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-197.ec2.internal\" not found" node="ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.197253 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.197225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/410039805fdc205adf87c72964399a65-config\") pod \"kube-apiserver-proxy-ip-10-0-136-197.ec2.internal\" (UID: \"410039805fdc205adf87c72964399a65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.197253 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.197256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c7f8e5015dbcb6e9ce0870de0d25572-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"2c7f8e5015dbcb6e9ce0870de0d25572\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.197406 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.197275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c7f8e5015dbcb6e9ce0870de0d25572-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"2c7f8e5015dbcb6e9ce0870de0d25572\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.199327 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.199305 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.297904 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.297880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c7f8e5015dbcb6e9ce0870de0d25572-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"2c7f8e5015dbcb6e9ce0870de0d25572\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.298047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.297909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c7f8e5015dbcb6e9ce0870de0d25572-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"2c7f8e5015dbcb6e9ce0870de0d25572\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.298047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.297926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/410039805fdc205adf87c72964399a65-config\") pod \"kube-apiserver-proxy-ip-10-0-136-197.ec2.internal\" (UID: \"410039805fdc205adf87c72964399a65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.298047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.297980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/410039805fdc205adf87c72964399a65-config\") pod \"kube-apiserver-proxy-ip-10-0-136-197.ec2.internal\" (UID: \"410039805fdc205adf87c72964399a65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.298047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.297985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c7f8e5015dbcb6e9ce0870de0d25572-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"2c7f8e5015dbcb6e9ce0870de0d25572\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.298047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.297988 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c7f8e5015dbcb6e9ce0870de0d25572-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal\" (UID: \"2c7f8e5015dbcb6e9ce0870de0d25572\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.300002 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.299985 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.400375 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.400322 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.466512 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.466493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.470109 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.470090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:47:59.501332 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.501307 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.601831 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.601803 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.702479 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.702419 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.706845 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.706826 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:59.803287 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.803258 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.840438 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.840415 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 14:47:59.840818 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.840535 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:59.840818 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.840567 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:59.903337 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:47:59.903313 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:47:59.913996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.913969 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 14:42:58 +0000 UTC" deadline="2028-03-14 00:02:15.761729906 +0000 UTC" Jul 31 14:47:59.913996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:47:59.913994 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14193h14m15.847738729s" Jul 31 14:48:00.003597 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.003570 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:48:00.095723 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:00.095697 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410039805fdc205adf87c72964399a65.slice/crio-484ab8113937a7174416a085688ab406f72d6352138de9b674a6e00c166b5d23 WatchSource:0}: Error finding container 484ab8113937a7174416a085688ab406f72d6352138de9b674a6e00c166b5d23: Status 404 returned error can't find the container with id 484ab8113937a7174416a085688ab406f72d6352138de9b674a6e00c166b5d23 Jul 31 14:48:00.096398 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:00.096378 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7f8e5015dbcb6e9ce0870de0d25572.slice/crio-ec0ed79a5131b79c6a6f2b574d1f85785fde7950d4ef65097e2cb5b1b5f0eb03 WatchSource:0}: Error finding container ec0ed79a5131b79c6a6f2b574d1f85785fde7950d4ef65097e2cb5b1b5f0eb03: Status 404 returned error can't find the container with id ec0ed79a5131b79c6a6f2b574d1f85785fde7950d4ef65097e2cb5b1b5f0eb03 Jul 31 14:48:00.101314 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.101300 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:48:00.103997 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.103980 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:48:00.204195 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.204175 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:48:00.304827 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.304774 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:48:00.404986 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.404961 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-197.ec2.internal\" not found" Jul 31 14:48:00.405565 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.405551 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:48:00.448917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.448898 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:48:00.494568 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.494545 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" Jul 31 14:48:00.509605 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.509585 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:48:00.510842 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.510827 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" Jul 31 14:48:00.533197 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.533173 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:48:00.762213 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.762135 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:48:00.878271 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.878239 2579 apiserver.go:52] "Watching apiserver" Jul 31 14:48:00.887809 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.887780 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 14:48:00.888261 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.888235 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-268vx","kube-system/konnectivity-agent-dp59z","kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4","openshift-cluster-node-tuning-operator/tuned-gz59c","openshift-dns/node-resolver-s9npp","openshift-image-registry/node-ca-knb6c","openshift-multus/multus-fffbd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal","openshift-multus/multus-additional-cni-plugins-hrs6x","openshift-multus/network-metrics-daemon-bcwrf","openshift-network-diagnostics/network-check-target-d8rt9","openshift-network-operator/iptables-alerter-vwq9v","openshift-ovn-kubernetes/ovnkube-node-qnsmj"] Jul 31 14:48:00.891126 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.891104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:00.893355 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.893333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:00.894520 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.894499 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 14:48:00.894893 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.894872 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 14:48:00.895895 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.895876 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.896370 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.896113 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.896448 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.896350 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rh68j\"" Jul 31 14:48:00.899019 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.897762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.899019 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.897986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.899019 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.898319 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fj6w9\"" Jul 31 14:48:00.899019 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.898502 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.899019 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.898750 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 14:48:00.900032 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.900013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:00.900991 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.900702 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.901446 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.901415 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ckbcj\"" Jul 31 14:48:00.901604 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.901586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 14:48:00.901604 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.901605 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 14:48:00.901722 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.901588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.902430 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.902412 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 14:48:00.902508 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.902442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:00.902821 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.902802 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 14:48:00.903984 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.903965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.904810 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.904786 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:00.906087 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.906070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-log-socket\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.906222 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.906206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-cni-bin\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.906395 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.906377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovnkube-script-lib\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.906570 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.906552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4lvm\" (UniqueName: \"kubernetes.io/projected/e0de3da3-09ef-44f3-876a-de6275d16f7b-kube-api-access-t4lvm\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.906735 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.906721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4837bfb4-3359-4f71-9550-649536bbf1c6-host\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:00.906915 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.906900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-ovn\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.907091 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.907076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-kubelet\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.907239 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.907224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-run-netns\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.907853 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.907317 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fffbd" Jul 31 14:48:00.907984 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.907390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908112 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-host-slash\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:00.908225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-node-log\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-systemd\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-etc-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovnkube-config\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovn-node-metrics-cert\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4837bfb4-3359-4f71-9550-649536bbf1c6-serviceca\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:00.908388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrrs\" (UniqueName: \"kubernetes.io/projected/4837bfb4-3359-4f71-9550-649536bbf1c6-kube-api-access-9vrrs\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:00.908388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-var-lib-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-iptables-alerter-script\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-systemd-units\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-slash\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkz2\" (UniqueName: \"kubernetes.io/projected/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-kube-api-access-rfkz2\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-cni-netd\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.908683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.908617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-env-overrides\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.909652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.909782 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.909858 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6tqvx\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x7fl2\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910113 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910211 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910223 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910232 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6qvcc\"" Jul 31 14:48:00.910601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.910279 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.912013 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.911993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:00.913401 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.913222 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.913401 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.913264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.913401 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.913286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-84vkd\"" Jul 31 14:48:00.913401 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.913298 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 14:48:00.913662 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.913480 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 14:48:00.914653 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.914634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:00.917020 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.916999 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:00.917118 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.917077 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:00.919579 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.919501 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:00.919579 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:00.919552 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:00.921836 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.921815 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 14:48:00.922095 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.922079 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-svgjl\"" Jul 31 14:48:00.922306 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.922291 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 14:48:00.925502 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.925473 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:48:00.925753 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.925734 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 14:48:00.925936 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.925917 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 14:48:00.926149 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.926131 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6pgft\"" Jul 31 14:48:00.926827 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.926771 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 14:48:00.947548 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.947511 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gqmtj" Jul 31 14:48:00.965815 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.965797 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gqmtj" Jul 31 14:48:00.996976 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:00.996938 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 14:48:01.009626 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4lvm\" (UniqueName: \"kubernetes.io/projected/e0de3da3-09ef-44f3-876a-de6275d16f7b-kube-api-access-t4lvm\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.009764 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-kubernetes\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.009764 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-var-lib-kubelet\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.009764 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-k8s-cni-cncf-io\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.009764 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zf5\" (UniqueName: \"kubernetes.io/projected/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-kube-api-access-g7zf5\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:01.009972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:01.009972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-modprobe-d\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.009972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-cnibin\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.009972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6cc103b-7120-4a5e-98a5-c36a675afd9a-dbus\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.009972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysctl-conf\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.009972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-systemd\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.009984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-sys\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-kubelet\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-kubelet\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b718814-68f4-44d8-a708-fd7bff848117-tmp\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-kubelet\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-hostroot\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb78c338-1ab4-400b-9129-ee09898ba076-konnectivity-ca\") pod \"konnectivity-agent-dp59z\" (UID: \"cb78c338-1ab4-400b-9129-ee09898ba076\") " pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010211 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-node-log\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4837bfb4-3359-4f71-9550-649536bbf1c6-serviceca\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010312 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-system-cni-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010319 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-node-log\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-os-release\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjwjh\" (UniqueName: \"kubernetes.io/projected/ed810c79-b9a7-4d79-b66b-266e18a9b254-kube-api-access-tjwjh\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb78c338-1ab4-400b-9129-ee09898ba076-agent-certs\") pod \"konnectivity-agent-dp59z\" (UID: \"cb78c338-1ab4-400b-9129-ee09898ba076\") " pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-iptables-alerter-script\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42l27\" (UniqueName: \"kubernetes.io/projected/abc2fad7-2afc-4376-b4db-d951323d69e8-kube-api-access-42l27\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-cni-multus\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-daemon-config\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.010638 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-systemd-units\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-slash\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkz2\" (UniqueName: \"kubernetes.io/projected/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-kube-api-access-rfkz2\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-socket-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4837bfb4-3359-4f71-9550-649536bbf1c6-serviceca\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5vlc\" (UniqueName: \"kubernetes.io/projected/5863e7d5-1b83-4981-af37-d9b915e342a7-kube-api-access-f5vlc\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.010894 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-systemd-units\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-iptables-alerter-script\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-cni-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-registration-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-device-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc2fad7-2afc-4376-b4db-d951323d69e8-tmp-dir\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-netns\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-multus-certs\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-slash\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-etc-kubernetes\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-log-socket\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-cni-bin\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-log-socket\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovnkube-script-lib\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b718814-68f4-44d8-a708-fd7bff848117-etc-tuned\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-conf-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-cni-bin\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4837bfb4-3359-4f71-9550-649536bbf1c6-host\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-sys-fs\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysctl-d\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-host\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed810c79-b9a7-4d79-b66b-266e18a9b254-cni-binary-copy\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-socket-dir-parent\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-cni-bin\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-ovn\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfszj\" (UniqueName: \"kubernetes.io/projected/7b718814-68f4-44d8-a708-fd7bff848117-kube-api-access-wfszj\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-run-netns\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-host-slash\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovnkube-script-lib\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-run\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-ovn\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-lib-modules\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.011996 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.011998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-run-netns\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-host-slash\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-systemd\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012034 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4837bfb4-3359-4f71-9550-649536bbf1c6-host\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-etc-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-run-systemd\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovnkube-config\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-etc-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovn-node-metrics-cert\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrrs\" (UniqueName: \"kubernetes.io/projected/4837bfb4-3359-4f71-9550-649536bbf1c6-kube-api-access-9vrrs\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-system-cni-dir\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-cnibin\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-var-lib-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysconfig\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abc2fad7-2afc-4376-b4db-d951323d69e8-hosts-file\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6cc103b-7120-4a5e-98a5-c36a675afd9a-kubelet-config\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-os-release\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.012748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wj86\" (UniqueName: \"kubernetes.io/projected/abd693c7-86e2-473d-9233-82d0b4e434ad-kube-api-access-8wj86\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-cni-netd\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovnkube-config\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012594 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-host-cni-netd\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0de3da3-09ef-44f3-876a-de6275d16f7b-var-lib-openvswitch\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-env-overrides\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.012588 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 14:48:01.013411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.013057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0de3da3-09ef-44f3-876a-de6275d16f7b-env-overrides\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.016429 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.016380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0de3da3-09ef-44f3-876a-de6275d16f7b-ovn-node-metrics-cert\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.021060 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.021038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkz2\" (UniqueName: \"kubernetes.io/projected/ed4af2fd-51d0-4843-ba8d-eb32ca51ca64-kube-api-access-rfkz2\") pod \"iptables-alerter-vwq9v\" (UID: \"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64\") " pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.021293 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.021272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4lvm\" (UniqueName: \"kubernetes.io/projected/e0de3da3-09ef-44f3-876a-de6275d16f7b-kube-api-access-t4lvm\") pod \"ovnkube-node-qnsmj\" (UID: \"e0de3da3-09ef-44f3-876a-de6275d16f7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.025063 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.025040 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrrs\" (UniqueName: \"kubernetes.io/projected/4837bfb4-3359-4f71-9550-649536bbf1c6-kube-api-access-9vrrs\") pod \"node-ca-knb6c\" (UID: \"4837bfb4-3359-4f71-9550-649536bbf1c6\") " pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.042303 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.042257 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" event={"ID":"2c7f8e5015dbcb6e9ce0870de0d25572","Type":"ContainerStarted","Data":"ec0ed79a5131b79c6a6f2b574d1f85785fde7950d4ef65097e2cb5b1b5f0eb03"} Jul 31 14:48:01.043590 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.043565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" event={"ID":"410039805fdc205adf87c72964399a65","Type":"ContainerStarted","Data":"484ab8113937a7174416a085688ab406f72d6352138de9b674a6e00c166b5d23"} Jul 31 14:48:01.113802 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-netns\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-multus-certs\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-etc-kubernetes\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b718814-68f4-44d8-a708-fd7bff848117-etc-tuned\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-conf-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-multus-certs\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-netns\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-sys-fs\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-etc-kubernetes\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.113990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.113979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysctl-d\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-host\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed810c79-b9a7-4d79-b66b-266e18a9b254-cni-binary-copy\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-socket-dir-parent\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-conf-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-cni-bin\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfszj\" (UniqueName: \"kubernetes.io/projected/7b718814-68f4-44d8-a708-fd7bff848117-kube-api-access-wfszj\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114085 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-cni-bin\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114118 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-run\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-lib-modules\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-system-cni-dir\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-cnibin\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysconfig\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abc2fad7-2afc-4376-b4db-d951323d69e8-hosts-file\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.114530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6cc103b-7120-4a5e-98a5-c36a675afd9a-kubelet-config\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-os-release\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wj86\" (UniqueName: \"kubernetes.io/projected/abd693c7-86e2-473d-9233-82d0b4e434ad-kube-api-access-8wj86\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114428 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysctl-d\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-kubernetes\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-var-lib-kubelet\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114491 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-sys-fs\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-k8s-cni-cncf-io\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-run-k8s-cni-cncf-io\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zf5\" (UniqueName: \"kubernetes.io/projected/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-kube-api-access-g7zf5\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-socket-dir-parent\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-modprobe-d\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-cnibin\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6cc103b-7120-4a5e-98a5-c36a675afd9a-dbus\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.115329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysctl-conf\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed810c79-b9a7-4d79-b66b-266e18a9b254-cni-binary-copy\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-systemd\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-sys\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-kubelet\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-host\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b718814-68f4-44d8-a708-fd7bff848117-tmp\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.114978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-hostroot\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb78c338-1ab4-400b-9129-ee09898ba076-konnectivity-ca\") pod \"konnectivity-agent-dp59z\" (UID: \"cb78c338-1ab4-400b-9129-ee09898ba076\") " pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-system-cni-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-os-release\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjwjh\" (UniqueName: \"kubernetes.io/projected/ed810c79-b9a7-4d79-b66b-266e18a9b254-kube-api-access-tjwjh\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb78c338-1ab4-400b-9129-ee09898ba076-agent-certs\") pod \"konnectivity-agent-dp59z\" (UID: \"cb78c338-1ab4-400b-9129-ee09898ba076\") " pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42l27\" (UniqueName: \"kubernetes.io/projected/abc2fad7-2afc-4376-b4db-d951323d69e8-kube-api-access-42l27\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-cni-multus\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-daemon-config\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.116148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-socket-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5vlc\" (UniqueName: \"kubernetes.io/projected/5863e7d5-1b83-4981-af37-d9b915e342a7-kube-api-access-f5vlc\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-cni-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-registration-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-device-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc2fad7-2afc-4376-b4db-d951323d69e8-tmp-dir\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.115761 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.115801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc2fad7-2afc-4376-b4db-d951323d69e8-tmp-dir\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.115830 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:48:01.615810311 +0000 UTC m=+3.075423687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116069 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-socket-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116086 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-hostroot\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb78c338-1ab4-400b-9129-ee09898ba076-konnectivity-ca\") pod \"konnectivity-agent-dp59z\" (UID: \"cb78c338-1ab4-400b-9129-ee09898ba076\") " pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-system-cni-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.116977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-cni-dir\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-registration-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-os-release\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116747 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5863e7d5-1b83-4981-af37-d9b915e342a7-device-dir\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.116967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-run\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117054 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-kubernetes\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-lib-modules\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-systemd\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6cc103b-7120-4a5e-98a5-c36a675afd9a-dbus\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117125 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-system-cni-dir\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117201 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysconfig\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-sysctl-conf\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abc2fad7-2afc-4376-b4db-d951323d69e8-hosts-file\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-cnibin\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6cc103b-7120-4a5e-98a5-c36a675afd9a-kubelet-config\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b718814-68f4-44d8-a708-fd7bff848117-tmp\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/abd693c7-86e2-473d-9233-82d0b4e434ad-os-release\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-etc-modprobe-d\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.117625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117371 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-var-lib-kubelet\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-cnibin\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed810c79-b9a7-4d79-b66b-266e18a9b254-multus-daemon-config\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117510 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b718814-68f4-44d8-a708-fd7bff848117-sys\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117516 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-cni-multus\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117531 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed810c79-b9a7-4d79-b66b-266e18a9b254-host-var-lib-kubelet\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.117589 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.117741 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:48:01.617723654 +0000 UTC m=+3.077337024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b718814-68f4-44d8-a708-fd7bff848117-etc-tuned\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.118339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.117752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/abd693c7-86e2-473d-9233-82d0b4e434ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.119450 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.119432 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb78c338-1ab4-400b-9129-ee09898ba076-agent-certs\") pod \"konnectivity-agent-dp59z\" (UID: \"cb78c338-1ab4-400b-9129-ee09898ba076\") " pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.124590 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.124562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfszj\" (UniqueName: \"kubernetes.io/projected/7b718814-68f4-44d8-a708-fd7bff848117-kube-api-access-wfszj\") pod \"tuned-gz59c\" (UID: \"7b718814-68f4-44d8-a708-fd7bff848117\") " pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.126800 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.126760 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zf5\" (UniqueName: \"kubernetes.io/projected/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-kube-api-access-g7zf5\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:01.127019 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.127001 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:01.127092 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.127022 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:01.127092 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.127034 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:01.127092 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.127081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:01.627066944 +0000 UTC m=+3.086680314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:01.128724 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.128697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5vlc\" (UniqueName: \"kubernetes.io/projected/5863e7d5-1b83-4981-af37-d9b915e342a7-kube-api-access-f5vlc\") pod \"aws-ebs-csi-driver-node-wzsn4\" (UID: \"5863e7d5-1b83-4981-af37-d9b915e342a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.129220 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.129197 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjwjh\" (UniqueName: \"kubernetes.io/projected/ed810c79-b9a7-4d79-b66b-266e18a9b254-kube-api-access-tjwjh\") pod \"multus-fffbd\" (UID: \"ed810c79-b9a7-4d79-b66b-266e18a9b254\") " pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.129570 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.129551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wj86\" (UniqueName: \"kubernetes.io/projected/abd693c7-86e2-473d-9233-82d0b4e434ad-kube-api-access-8wj86\") pod \"multus-additional-cni-plugins-hrs6x\" (UID: \"abd693c7-86e2-473d-9233-82d0b4e434ad\") " pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.129640 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.129602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42l27\" (UniqueName: \"kubernetes.io/projected/abc2fad7-2afc-4376-b4db-d951323d69e8-kube-api-access-42l27\") pod \"node-resolver-s9npp\" (UID: \"abc2fad7-2afc-4376-b4db-d951323d69e8\") " pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.204879 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.204845 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-knb6c" Jul 31 14:48:01.213207 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.213183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwq9v" Jul 31 14:48:01.224920 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.224901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:01.230554 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.230535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" Jul 31 14:48:01.245109 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.245090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gz59c" Jul 31 14:48:01.251641 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.251624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s9npp" Jul 31 14:48:01.259220 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.259196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fffbd" Jul 31 14:48:01.267923 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.267865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:01.274501 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.274481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" Jul 31 14:48:01.617830 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.617744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:01.617999 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.617925 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:01.618069 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.618025 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:48:02.618004596 +0000 UTC m=+4.077617975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:01.668190 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.668159 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:48:01.718407 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.718380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:01.718553 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.718430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:01.718614 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.718553 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:01.718614 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.718558 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:01.718614 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.718576 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:01.718614 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.718588 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:01.718775 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.718621 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:48:02.7186045 +0000 UTC m=+4.178217857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:01.718775 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:01.718635 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:02.718628977 +0000 UTC m=+4.178242333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:01.968947 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.968896 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:43:00 +0000 UTC" deadline="2028-04-12 13:33:57.436779616 +0000 UTC" Jul 31 14:48:01.968947 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:01.968929 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14902h45m55.467854294s" Jul 31 14:48:02.006283 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.006262 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4af2fd_51d0_4843_ba8d_eb32ca51ca64.slice/crio-d97bbc780351ac2a245abe85e25185dc6d8c90f01659f7ce59a9ff9b9f6cb2e7 WatchSource:0}: Error finding container d97bbc780351ac2a245abe85e25185dc6d8c90f01659f7ce59a9ff9b9f6cb2e7: Status 404 returned error can't find the container with id d97bbc780351ac2a245abe85e25185dc6d8c90f01659f7ce59a9ff9b9f6cb2e7 Jul 31 14:48:02.025757 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.025733 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0de3da3_09ef_44f3_876a_de6275d16f7b.slice/crio-31ba6b9598186a58f80ab432c77009c9aea72506dd2664c8d561e762ab73c523 WatchSource:0}: Error finding container 31ba6b9598186a58f80ab432c77009c9aea72506dd2664c8d561e762ab73c523: Status 404 returned error can't find the container with id 31ba6b9598186a58f80ab432c77009c9aea72506dd2664c8d561e762ab73c523 Jul 31 14:48:02.026469 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.026434 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc2fad7_2afc_4376_b4db_d951323d69e8.slice/crio-bd7322c36da86d989086563ba8709574f628d8eeae012b8fb0e0b33f4ed93d5c WatchSource:0}: Error finding container bd7322c36da86d989086563ba8709574f628d8eeae012b8fb0e0b33f4ed93d5c: Status 404 returned error can't find the container with id bd7322c36da86d989086563ba8709574f628d8eeae012b8fb0e0b33f4ed93d5c Jul 31 14:48:02.027432 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.027410 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd693c7_86e2_473d_9233_82d0b4e434ad.slice/crio-5fff741d275b57fc114e8cdfb062af6b2471f40b7a2e4848ad9be6e22453e9bb WatchSource:0}: Error finding container 5fff741d275b57fc114e8cdfb062af6b2471f40b7a2e4848ad9be6e22453e9bb: Status 404 returned error can't find the container with id 5fff741d275b57fc114e8cdfb062af6b2471f40b7a2e4848ad9be6e22453e9bb Jul 31 14:48:02.033350 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.033291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded810c79_b9a7_4d79_b66b_266e18a9b254.slice/crio-d2c9d97948287c0fd6f20dfcc5091ce9d584a75f05766d873d0567c36ac4c17c WatchSource:0}: Error finding container d2c9d97948287c0fd6f20dfcc5091ce9d584a75f05766d873d0567c36ac4c17c: Status 404 returned error can't find the container with id d2c9d97948287c0fd6f20dfcc5091ce9d584a75f05766d873d0567c36ac4c17c Jul 31 14:48:02.037518 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.037500 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5863e7d5_1b83_4981_af37_d9b915e342a7.slice/crio-8a588e1d7e7b909ce73ef9f9e8233389eda246a1fbe0f709c0fe1850c7ef5216 WatchSource:0}: Error finding container 8a588e1d7e7b909ce73ef9f9e8233389eda246a1fbe0f709c0fe1850c7ef5216: Status 404 returned error can't find the container with id 8a588e1d7e7b909ce73ef9f9e8233389eda246a1fbe0f709c0fe1850c7ef5216 Jul 31 14:48:02.037953 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.037905 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b718814_68f4_44d8_a708_fd7bff848117.slice/crio-97232eb36bb948dea78a9cee076219509b9e4463289f000b3afe601b11460004 WatchSource:0}: Error finding container 97232eb36bb948dea78a9cee076219509b9e4463289f000b3afe601b11460004: Status 404 returned error can't find the container with id 97232eb36bb948dea78a9cee076219509b9e4463289f000b3afe601b11460004 Jul 31 14:48:02.038631 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.038614 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb78c338_1ab4_400b_9129_ee09898ba076.slice/crio-c107d8248516b85524866c5f4053e41ca3310620a2525ac65799dba68d8774d7 WatchSource:0}: Error finding container c107d8248516b85524866c5f4053e41ca3310620a2525ac65799dba68d8774d7: Status 404 returned error can't find the container with id c107d8248516b85524866c5f4053e41ca3310620a2525ac65799dba68d8774d7 Jul 31 14:48:02.040182 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:02.040159 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4837bfb4_3359_4f71_9550_649536bbf1c6.slice/crio-91ade948a440c848bf0fa4c6d307e2107bd7c07f7d2bc86f76a277aae130c750 WatchSource:0}: Error finding container 91ade948a440c848bf0fa4c6d307e2107bd7c07f7d2bc86f76a277aae130c750: Status 404 returned error can't find the container with id 91ade948a440c848bf0fa4c6d307e2107bd7c07f7d2bc86f76a277aae130c750 Jul 31 14:48:02.046055 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.045956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" event={"ID":"5863e7d5-1b83-4981-af37-d9b915e342a7","Type":"ContainerStarted","Data":"8a588e1d7e7b909ce73ef9f9e8233389eda246a1fbe0f709c0fe1850c7ef5216"} Jul 31 14:48:02.047214 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.047196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fffbd" event={"ID":"ed810c79-b9a7-4d79-b66b-266e18a9b254","Type":"ContainerStarted","Data":"d2c9d97948287c0fd6f20dfcc5091ce9d584a75f05766d873d0567c36ac4c17c"} Jul 31 14:48:02.048234 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.048218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s9npp" event={"ID":"abc2fad7-2afc-4376-b4db-d951323d69e8","Type":"ContainerStarted","Data":"bd7322c36da86d989086563ba8709574f628d8eeae012b8fb0e0b33f4ed93d5c"} Jul 31 14:48:02.049341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.049322 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwq9v" event={"ID":"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64","Type":"ContainerStarted","Data":"d97bbc780351ac2a245abe85e25185dc6d8c90f01659f7ce59a9ff9b9f6cb2e7"} Jul 31 14:48:02.050469 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.050451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-knb6c" event={"ID":"4837bfb4-3359-4f71-9550-649536bbf1c6","Type":"ContainerStarted","Data":"91ade948a440c848bf0fa4c6d307e2107bd7c07f7d2bc86f76a277aae130c750"} Jul 31 14:48:02.051494 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.051472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dp59z" event={"ID":"cb78c338-1ab4-400b-9129-ee09898ba076","Type":"ContainerStarted","Data":"c107d8248516b85524866c5f4053e41ca3310620a2525ac65799dba68d8774d7"} Jul 31 14:48:02.052719 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.052698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerStarted","Data":"5fff741d275b57fc114e8cdfb062af6b2471f40b7a2e4848ad9be6e22453e9bb"} Jul 31 14:48:02.053909 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.053889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"31ba6b9598186a58f80ab432c77009c9aea72506dd2664c8d561e762ab73c523"} Jul 31 14:48:02.054969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.054928 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gz59c" event={"ID":"7b718814-68f4-44d8-a708-fd7bff848117","Type":"ContainerStarted","Data":"97232eb36bb948dea78a9cee076219509b9e4463289f000b3afe601b11460004"} Jul 31 14:48:02.624957 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.624102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:02.624957 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.624481 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:02.624957 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.624552 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:48:04.624532161 +0000 UTC m=+6.084145543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.725133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.725247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.725392 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.725413 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.725426 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.725481 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:04.725464486 +0000 UTC m=+6.185077844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.725856 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:02.725960 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:02.725903 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:48:04.725888636 +0000 UTC m=+6.185501995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:02.970021 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.969900 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:43:00 +0000 UTC" deadline="2028-02-19 12:24:09.623223934 +0000 UTC" Jul 31 14:48:02.970021 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:02.969976 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13629h36m6.653251839s" Jul 31 14:48:03.039808 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.039764 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:03.040001 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:03.039886 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:03.040364 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.040336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:03.040749 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:03.040500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:03.040749 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.040595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:03.040749 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:03.040711 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:03.066296 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.066266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" event={"ID":"410039805fdc205adf87c72964399a65","Type":"ContainerStarted","Data":"0ede7ab693195304b836ea59c7d92d4f36dfcedb4558b942b01b2ba04829c191"} Jul 31 14:48:03.069083 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.069020 2579 generic.go:356] "Generic (PLEG): container finished" podID="2c7f8e5015dbcb6e9ce0870de0d25572" containerID="b3dfae958c45912b9eae8fc1f9781933ff91f9827894b6e95ca69cc21c87e8f5" exitCode=0 Jul 31 14:48:03.069186 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.069096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" event={"ID":"2c7f8e5015dbcb6e9ce0870de0d25572","Type":"ContainerDied","Data":"b3dfae958c45912b9eae8fc1f9781933ff91f9827894b6e95ca69cc21c87e8f5"} Jul 31 14:48:03.083835 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:03.083787 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-197.ec2.internal" podStartSLOduration=3.083771413 podStartE2EDuration="3.083771413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:03.083109759 +0000 UTC m=+4.542723137" watchObservedRunningTime="2026-07-31 14:48:03.083771413 +0000 UTC m=+4.543384793" Jul 31 14:48:04.091522 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:04.091433 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" event={"ID":"2c7f8e5015dbcb6e9ce0870de0d25572","Type":"ContainerStarted","Data":"5232ebd0f12bf16dafc54ab97daf452d98f78427d1815da76c371726121680f8"} Jul 31 14:48:04.108390 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:04.108210 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-197.ec2.internal" podStartSLOduration=4.108190373 podStartE2EDuration="4.108190373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:04.107437717 +0000 UTC m=+5.567051096" watchObservedRunningTime="2026-07-31 14:48:04.108190373 +0000 UTC m=+5.567803752" Jul 31 14:48:04.656267 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:04.656230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:04.656508 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.656397 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:04.656508 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.656460 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:48:08.656439196 +0000 UTC m=+10.116052575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:04.757068 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:04.757035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:04.757243 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:04.757092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:04.757243 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.757210 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:04.757357 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.757267 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:48:08.757249014 +0000 UTC m=+10.216862387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:04.757357 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.757280 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:04.757357 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.757307 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:04.757357 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.757321 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:04.757549 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:04.757373 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:08.757356998 +0000 UTC m=+10.216970367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:05.039449 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:05.039376 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:05.039586 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:05.039508 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:05.039586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:05.039570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:05.039700 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:05.039648 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:05.039700 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:05.039686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:05.039774 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:05.039745 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:07.038094 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:07.038056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:07.038508 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:07.038201 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:07.038508 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:07.038209 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:07.038508 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:07.038244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:07.038508 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:07.038381 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:07.038508 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:07.038457 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:08.689178 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:08.689143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:08.689574 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.689287 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:08.689574 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.689343 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:48:16.689325239 +0000 UTC m=+18.148938596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:08.790123 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:08.790085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:08.790123 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:08.790129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:08.790328 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.790233 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:08.790328 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.790284 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:48:16.790271274 +0000 UTC m=+18.249884649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:08.790649 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.790630 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:08.790744 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.790655 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:08.790744 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.790667 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:08.790744 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:08.790711 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:16.790696887 +0000 UTC m=+18.250310248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:09.038024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:09.036841 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:09.038024 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:09.036979 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:09.038281 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:09.038163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:09.038281 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:09.038248 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:09.038538 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:09.038512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:09.038647 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:09.038601 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:11.038443 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:11.038409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:11.038852 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:11.038508 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:11.038852 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:11.038805 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:11.038972 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:11.038872 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:11.038972 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:11.038907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:11.039062 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:11.038973 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:13.037676 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:13.037640 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:13.037676 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:13.037663 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:13.038295 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:13.037786 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:13.038295 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:13.037781 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:13.038295 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:13.037854 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:13.038295 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:13.037956 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:15.037599 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:15.037506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:15.037599 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:15.037506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:15.037599 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:15.037563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:15.038136 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:15.037660 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:15.038136 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:15.037738 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:15.038136 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:15.037832 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:16.748135 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:16.748088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:16.748501 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.748272 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:16.748501 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.748346 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.748329066 +0000 UTC m=+34.207942425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:16.848560 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:16.848465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:16.848560 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:16.848557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:16.848780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.848622 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:16.848780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.848659 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:16.848780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.848673 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:16.848780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.848685 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:16.848780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.848691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.848671408 +0000 UTC m=+34.308284781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:16.848780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:16.848718 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.848708867 +0000 UTC m=+34.308322223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:17.037513 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:17.037472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:17.037661 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:17.037476 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:17.037661 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:17.037619 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:17.037661 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:17.037478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:17.037833 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:17.037683 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:17.037833 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:17.037753 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:19.037608 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:19.037576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:19.038057 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:19.037657 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:19.038057 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:19.037776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:19.038057 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:19.037876 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:19.038057 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:19.037948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:19.038057 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:19.038024 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:21.043501 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.043239 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:21.043980 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.043263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:21.043980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:21.043619 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:21.043980 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.043263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:21.043980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:21.043658 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:21.043980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:21.043716 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:21.124609 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.124580 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fffbd" event={"ID":"ed810c79-b9a7-4d79-b66b-266e18a9b254","Type":"ContainerStarted","Data":"16db0c59c9665069dbdab4ebfc4a7797ca5c06dbf6e22b9d5c4a762f692fd472"} Jul 31 14:48:21.126083 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.126058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s9npp" event={"ID":"abc2fad7-2afc-4376-b4db-d951323d69e8","Type":"ContainerStarted","Data":"a5b76cf04d4ad5c0501cf448c902eef7a34748e42a76ec2ab9790bd0372c9c8e"} Jul 31 14:48:21.127446 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.127417 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-knb6c" event={"ID":"4837bfb4-3359-4f71-9550-649536bbf1c6","Type":"ContainerStarted","Data":"a20cc9816bf6f8615908567a32f81a71006db191e01672e10021aca8a010ca0c"} Jul 31 14:48:21.128875 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.128850 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dp59z" event={"ID":"cb78c338-1ab4-400b-9129-ee09898ba076","Type":"ContainerStarted","Data":"fdb827604cfe078f41bc6fc92fbecaa77038417bceda354fac18b6682c4f1f47"} Jul 31 14:48:21.130476 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.130449 2579 generic.go:356] "Generic (PLEG): container finished" podID="abd693c7-86e2-473d-9233-82d0b4e434ad" containerID="79e6bc3e25cf5a273638565ee2363aa7c65aa45a2d993ad79856635593306df3" exitCode=0 Jul 31 14:48:21.130569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.130544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerDied","Data":"79e6bc3e25cf5a273638565ee2363aa7c65aa45a2d993ad79856635593306df3"} Jul 31 14:48:21.132635 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.132613 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:48:21.133040 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.133021 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0de3da3-09ef-44f3-876a-de6275d16f7b" containerID="309db564b758a9c9a04e7f66e66452195bb809c085f663b7897de23c4836bde6" exitCode=1 Jul 31 14:48:21.133137 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.133049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerDied","Data":"309db564b758a9c9a04e7f66e66452195bb809c085f663b7897de23c4836bde6"} Jul 31 14:48:21.133137 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.133127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"3184ae5cc9d2791349454a0b4be6c7ccb16eb41674ff2638257b12aef26968f0"} Jul 31 14:48:21.134837 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.134816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gz59c" event={"ID":"7b718814-68f4-44d8-a708-fd7bff848117","Type":"ContainerStarted","Data":"d2ba75a43d9d678bdc2a409dbbcc300cdc160f527c3fdd6491c087bb95a5937a"} Jul 31 14:48:21.136734 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.136707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" event={"ID":"5863e7d5-1b83-4981-af37-d9b915e342a7","Type":"ContainerStarted","Data":"bcdd166ca7227d241ff9b4961133e6e5ad87f83ade46e7a18151d018541303be"} Jul 31 14:48:21.160291 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.160252 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-knb6c" podStartSLOduration=3.535817165 podStartE2EDuration="22.160238701s" totalImagesPullingTime="18.624421536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:21.159460563 +0000 UTC m=+22.619073941" watchObservedRunningTime="2026-07-31 14:48:21.160238701 +0000 UTC m=+22.619852124" Jul 31 14:48:21.160385 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.160319 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fffbd" podStartSLOduration=3.472219118 podStartE2EDuration="22.160312719s" totalImagesPullingTime="18.688093601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:21.143926816 +0000 UTC m=+22.603540201" watchObservedRunningTime="2026-07-31 14:48:21.160312719 +0000 UTC m=+22.619926096" Jul 31 14:48:21.174556 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.174514 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s9npp" podStartSLOduration=3.558207107 podStartE2EDuration="22.174496026s" totalImagesPullingTime="18.616288919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:21.174263561 +0000 UTC m=+22.633876938" watchObservedRunningTime="2026-07-31 14:48:21.174496026 +0000 UTC m=+22.634109405" Jul 31 14:48:21.189474 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.189429 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dp59z" podStartSLOduration=7.71049235 podStartE2EDuration="22.189415744s" totalImagesPullingTime="14.478923394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:21.189235348 +0000 UTC m=+22.648848727" watchObservedRunningTime="2026-07-31 14:48:21.189415744 +0000 UTC m=+22.649029122" Jul 31 14:48:21.237782 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.237648 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gz59c" podStartSLOduration=3.611004449 podStartE2EDuration="22.237635339s" totalImagesPullingTime="18.62663089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:21.237423373 +0000 UTC m=+22.697036750" watchObservedRunningTime="2026-07-31 14:48:21.237635339 +0000 UTC m=+22.697248717" Jul 31 14:48:21.302307 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.302247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:21.371254 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:21.371220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:22.144560 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.144033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwq9v" event={"ID":"ed4af2fd-51d0-4843-ba8d-eb32ca51ca64","Type":"ContainerStarted","Data":"a8080ec3cda080c27ff4808751eed5edd14f61906361ec6b609ed328348ce57d"} Jul 31 14:48:22.147464 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.147446 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:48:22.147875 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.147851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"5478b4e0f454a1bac794b59e988cd1452b6625bce74cb24f7be88002e913edd0"} Jul 31 14:48:22.147969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.147912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"a5af41932e4024cbd4d181925ff7aad2a8c5fcd0f8436e5db4d94c2e06fe1312"} Jul 31 14:48:22.147969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.147964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"25db37c05147bf852ac0a233669aadb9910d04d5972148de118a003560314478"} Jul 31 14:48:22.148080 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.148024 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"4091a856475085aaa70d83fdc6ecc96d4d3750d55e827a448e9dddd3127a3f55"} Jul 31 14:48:22.164243 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.164207 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vwq9v" podStartSLOduration=4.522490026 podStartE2EDuration="23.164195839s" totalImagesPullingTime="18.641705813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:22.1639471 +0000 UTC m=+23.623560471" watchObservedRunningTime="2026-07-31 14:48:22.164195839 +0000 UTC m=+23.623809217" Jul 31 14:48:22.236320 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.236295 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 14:48:22.301591 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.301538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:22.465175 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.465136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:22.636774 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.636703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:22.637291 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.637274 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:22.970184 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.970016 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T14:48:22.236317026Z","UUID":"06db1879-8b30-4ac6-928e-a0fc71b96b23","Handler":null,"Name":"","Endpoint":""} Jul 31 14:48:22.971691 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.971671 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 14:48:22.971816 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:22.971711 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 14:48:23.041100 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.041068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:23.041274 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:23.041195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:23.041274 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.041069 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:23.041274 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:23.041265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:23.041274 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.041068 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:23.041487 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:23.041315 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:23.152550 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.152517 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" event={"ID":"5863e7d5-1b83-4981-af37-d9b915e342a7","Type":"ContainerStarted","Data":"3099843c909748452ac35b63f2372708cdd93e55280b6a3b356d383e8d083d29"} Jul 31 14:48:23.153039 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.152813 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:23.153231 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.153210 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dp59z" Jul 31 14:48:23.231808 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:23.231697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:24.157699 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:24.157660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" event={"ID":"5863e7d5-1b83-4981-af37-d9b915e342a7","Type":"ContainerStarted","Data":"6d8ee31a3f77b12278f246ad78d5359ec0cc518ed0978c964b4f9d7381f5b475"} Jul 31 14:48:24.161159 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:24.161137 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:48:24.161526 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:24.161504 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"ee6456c7b53b2c9b17cb184ff84e4b699c319212e40645b898f908dede75829f"} Jul 31 14:48:24.183649 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:24.183394 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzsn4" podStartSLOduration=4.371996601 podStartE2EDuration="25.183378654s" totalImagesPullingTime="20.811382053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:24.183200636 +0000 UTC m=+25.642814015" watchObservedRunningTime="2026-07-31 14:48:24.183378654 +0000 UTC m=+25.642992032" Jul 31 14:48:25.037743 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:25.037708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:25.037952 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:25.037709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:25.037952 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:25.037837 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:25.038072 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:25.037708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:25.038072 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:25.037954 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:25.038072 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:25.038055 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:27.037507 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.037308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:27.038236 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.037326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:27.038236 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:27.037589 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:27.038236 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:27.037687 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:27.038236 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.037377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:27.038236 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:27.037772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:27.169811 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.169739 2579 generic.go:356] "Generic (PLEG): container finished" podID="abd693c7-86e2-473d-9233-82d0b4e434ad" containerID="2d746c0a834cc03d02f5ca6b5124d7585d677ee366a27cfa418aaf0ed008d80d" exitCode=0 Jul 31 14:48:27.169968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.169828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerDied","Data":"2d746c0a834cc03d02f5ca6b5124d7585d677ee366a27cfa418aaf0ed008d80d"} Jul 31 14:48:27.174140 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.174123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:48:27.174539 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.174507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"3177413a0ea56c96e108490ba4cdf23e53f5bdac548f26d5a251f18cf122e655"} Jul 31 14:48:27.174813 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.174789 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:27.175015 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.174859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:27.175015 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.174991 2579 scope.go:117] "RemoveContainer" containerID="309db564b758a9c9a04e7f66e66452195bb809c085f663b7897de23c4836bde6" Jul 31 14:48:27.192701 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.192669 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:27.241275 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.239274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:27.340895 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:27.340871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:28.179978 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.179889 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:48:28.180314 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.180267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" event={"ID":"e0de3da3-09ef-44f3-876a-de6275d16f7b","Type":"ContainerStarted","Data":"ee4e6228e17322f8d5468516a78c9a3f0c29f1097bed23562fb47ccf1496be5a"} Jul 31 14:48:28.180557 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.180519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:28.182544 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.182521 2579 generic.go:356] "Generic (PLEG): container finished" podID="abd693c7-86e2-473d-9233-82d0b4e434ad" containerID="ea97baab99672214b42d154dcd773773b1f73471cd1dce10a27a7ec8e394ecc2" exitCode=0 Jul 31 14:48:28.182645 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.182551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerDied","Data":"ea97baab99672214b42d154dcd773773b1f73471cd1dce10a27a7ec8e394ecc2"} Jul 31 14:48:28.195527 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.195509 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:48:28.215746 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.215696 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" podStartSLOduration=10.543202333 podStartE2EDuration="29.215684597s" totalImagesPullingTime="18.672482264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:28.214895154 +0000 UTC m=+29.674508532" watchObservedRunningTime="2026-07-31 14:48:28.215684597 +0000 UTC m=+29.675297975" Jul 31 14:48:28.495155 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.495082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-268vx"] Jul 31 14:48:28.495280 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.495177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:28.495280 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:28.495265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:28.497318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.497280 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d8rt9"] Jul 31 14:48:28.497445 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.497393 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:28.497503 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:28.497483 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:28.497950 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.497913 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcwrf"] Jul 31 14:48:28.498063 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:28.498049 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:28.498180 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:28.498160 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:29.186653 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:29.186424 2579 generic.go:356] "Generic (PLEG): container finished" podID="abd693c7-86e2-473d-9233-82d0b4e434ad" containerID="8f920a81c0d43616f2d27608a2526b60540455fc76c7f785e15ccaad3c5a6ac8" exitCode=0 Jul 31 14:48:29.187016 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:29.186477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerDied","Data":"8f920a81c0d43616f2d27608a2526b60540455fc76c7f785e15ccaad3c5a6ac8"} Jul 31 14:48:30.037630 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:30.037593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:30.037780 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:30.037593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:30.037780 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:30.037728 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:30.037898 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:30.037605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:30.037898 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:30.037817 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:30.037898 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:30.037864 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:30.822264 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:30.822223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:30.924907 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:30.924815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:31.048265 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:31.048223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:31.213634 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:31.213544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:31.335006 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:31.334972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:31.445201 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:31.445169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:31.843365 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:31.843333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:32.037620 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.037587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:32.037746 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.037693 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:32.037746 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.037697 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-268vx" podUID="c6cc103b-7120-4a5e-98a5-c36a675afd9a" Jul 31 14:48:32.037820 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.037788 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcwrf" podUID="9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b" Jul 31 14:48:32.037820 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.037699 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:32.037881 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.037866 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d8rt9" podUID="f7b865db-d41b-4716-ae2b-3c442726bc38" Jul 31 14:48:32.220586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.220489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:32.311173 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.311128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:32.763187 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.763149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:32.763348 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.763314 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:32.763403 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.763382 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs podName:9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b nodeName:}" failed. No retries permitted until 2026-07-31 14:49:04.763363127 +0000 UTC m=+66.222976488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs") pod "network-metrics-daemon-bcwrf" (UID: "9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:32.864449 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.864421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:32.864495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.864586 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.864599 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.864614 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.864628 2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6jf8 for pod openshift-network-diagnostics/network-check-target-d8rt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.864653 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret podName:c6cc103b-7120-4a5e-98a5-c36a675afd9a nodeName:}" failed. No retries permitted until 2026-07-31 14:49:04.864633562 +0000 UTC m=+66.324246940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret") pod "global-pull-secret-syncer-268vx" (UID: "c6cc103b-7120-4a5e-98a5-c36a675afd9a") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:32.864980 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:32.864669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8 podName:f7b865db-d41b-4716-ae2b-3c442726bc38 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:04.864660472 +0000 UTC m=+66.324273828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6jf8" (UniqueName: "kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8") pod "network-check-target-d8rt9" (UID: "f7b865db-d41b-4716-ae2b-3c442726bc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:33.018823 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.018758 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:33.093245 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.093213 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:33.400713 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.400685 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-197.ec2.internal" event="NodeReady" Jul 31 14:48:33.400873 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.400830 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 14:48:33.487739 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.487703 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:33.513105 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.513082 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bd777fcbc-spl84"] Jul 31 14:48:33.530162 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.530128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.536066 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.536046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 14:48:33.536388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.536349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 14:48:33.536691 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.536671 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m7lrf\"" Jul 31 14:48:33.536857 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.536836 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 14:48:33.542494 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.542475 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jn8r2"] Jul 31 14:48:33.545397 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.545353 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 14:48:33.554116 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.554097 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7wm6n"] Jul 31 14:48:33.554284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.554261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.561278 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.561262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4w6d9\"" Jul 31 14:48:33.564861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.564842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 14:48:33.564971 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.564862 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 14:48:33.568133 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.568106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd777fcbc-spl84"] Jul 31 14:48:33.568224 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.568205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.572127 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.572099 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 14:48:33.572233 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.572146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7wm6n"] Jul 31 14:48:33.572424 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.572407 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 14:48:33.572679 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.572663 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 14:48:33.572864 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.572850 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ls75f\"" Jul 31 14:48:33.584908 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.584803 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jn8r2"] Jul 31 14:48:33.662566 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.662536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:33.671364 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9f65952-aa49-4545-b74f-062f5a5d42e7-ca-trust-extracted\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-installation-pull-secrets\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.671479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-trusted-ca\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/706fdd7b-4f48-4841-9302-a70ccea9d7d8-cert\") pod \"ingress-canary-7wm6n\" (UID: \"706fdd7b-4f48-4841-9302-a70ccea9d7d8\") " pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.671636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-image-registry-private-configuration\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc4fs\" (UniqueName: \"kubernetes.io/projected/560b6bef-50d2-4856-ba18-981e1230d6ab-kube-api-access-kc4fs\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.671636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/560b6bef-50d2-4856-ba18-981e1230d6ab-tmp-dir\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.671636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q2j9\" (UniqueName: \"kubernetes.io/projected/706fdd7b-4f48-4841-9302-a70ccea9d7d8-kube-api-access-6q2j9\") pod \"ingress-canary-7wm6n\" (UID: \"706fdd7b-4f48-4841-9302-a70ccea9d7d8\") " pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.671636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-bound-sa-token\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671805 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd6b4\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-kube-api-access-fd6b4\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671805 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-certificates\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.671805 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.671702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/560b6bef-50d2-4856-ba18-981e1230d6ab-config-volume\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.772681 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd6b4\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-kube-api-access-fd6b4\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.772830 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-certificates\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.772830 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/560b6bef-50d2-4856-ba18-981e1230d6ab-config-volume\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.772830 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9f65952-aa49-4545-b74f-062f5a5d42e7-ca-trust-extracted\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-installation-pull-secrets\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.773024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-trusted-ca\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/706fdd7b-4f48-4841-9302-a70ccea9d7d8-cert\") pod \"ingress-canary-7wm6n\" (UID: \"706fdd7b-4f48-4841-9302-a70ccea9d7d8\") " pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.773024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.772986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-image-registry-private-configuration\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773024 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc4fs\" (UniqueName: \"kubernetes.io/projected/560b6bef-50d2-4856-ba18-981e1230d6ab-kube-api-access-kc4fs\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/560b6bef-50d2-4856-ba18-981e1230d6ab-tmp-dir\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:33.773078 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2j9\" (UniqueName: \"kubernetes.io/projected/706fdd7b-4f48-4841-9302-a70ccea9d7d8-kube-api-access-6q2j9\") pod \"ingress-canary-7wm6n\" (UID: \"706fdd7b-4f48-4841-9302-a70ccea9d7d8\") " pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-bound-sa-token\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9f65952-aa49-4545-b74f-062f5a5d42e7-ca-trust-extracted\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773318 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:33.773134 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls podName:560b6bef-50d2-4856-ba18-981e1230d6ab nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.273113776 +0000 UTC m=+35.732727146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls") pod "dns-default-jn8r2" (UID: "560b6bef-50d2-4856-ba18-981e1230d6ab") : secret "dns-default-metrics-tls" not found Jul 31 14:48:33.773653 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-certificates\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.773653 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773439 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/560b6bef-50d2-4856-ba18-981e1230d6ab-config-volume\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.773653 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:33.773549 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:33.773653 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:33.773564 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd777fcbc-spl84: secret "image-registry-tls" not found Jul 31 14:48:33.773653 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:33.773616 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls podName:d9f65952-aa49-4545-b74f-062f5a5d42e7 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.273597301 +0000 UTC m=+35.733210668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls") pod "image-registry-5bd777fcbc-spl84" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7") : secret "image-registry-tls" not found Jul 31 14:48:33.773653 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.773646 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/560b6bef-50d2-4856-ba18-981e1230d6ab-tmp-dir\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.774025 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.774008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-trusted-ca\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.777237 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.777217 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/706fdd7b-4f48-4841-9302-a70ccea9d7d8-cert\") pod \"ingress-canary-7wm6n\" (UID: \"706fdd7b-4f48-4841-9302-a70ccea9d7d8\") " pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.777237 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.777228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-installation-pull-secrets\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.777384 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.777229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-image-registry-private-configuration\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.784884 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.784795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:33.785230 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.785207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd6b4\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-kube-api-access-fd6b4\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.786381 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.786363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-bound-sa-token\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:33.786585 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.786567 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc4fs\" (UniqueName: \"kubernetes.io/projected/560b6bef-50d2-4856-ba18-981e1230d6ab-kube-api-access-kc4fs\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:33.787827 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.787808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q2j9\" (UniqueName: \"kubernetes.io/projected/706fdd7b-4f48-4841-9302-a70ccea9d7d8-kube-api-access-6q2j9\") pod \"ingress-canary-7wm6n\" (UID: \"706fdd7b-4f48-4841-9302-a70ccea9d7d8\") " pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:33.878287 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:33.878233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7wm6n" Jul 31 14:48:34.036948 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.036918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:48:34.037043 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.036918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:48:34.037043 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.037036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:48:34.041059 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.041040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:48:34.041059 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.041051 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-262fz\"" Jul 31 14:48:34.041219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.041070 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:48:34.041219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.041077 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ljf7\"" Jul 31 14:48:34.041219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.041082 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:48:34.041219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.041122 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:48:34.240720 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.240470 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7wm6n"] Jul 31 14:48:34.244422 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:34.244402 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706fdd7b_4f48_4841_9302_a70ccea9d7d8.slice/crio-df222e3a420298c0e765fd29ce07e78618c2c269ff67614d82b3d1175f9bed00 WatchSource:0}: Error finding container df222e3a420298c0e765fd29ce07e78618c2c269ff67614d82b3d1175f9bed00: Status 404 returned error can't find the container with id df222e3a420298c0e765fd29ce07e78618c2c269ff67614d82b3d1175f9bed00 Jul 31 14:48:34.277295 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.277264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:34.277466 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:34.277311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:34.277466 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:34.277418 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:34.277466 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:34.277422 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:34.277617 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:34.277493 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls podName:560b6bef-50d2-4856-ba18-981e1230d6ab nodeName:}" failed. No retries permitted until 2026-07-31 14:48:35.277469709 +0000 UTC m=+36.737083079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls") pod "dns-default-jn8r2" (UID: "560b6bef-50d2-4856-ba18-981e1230d6ab") : secret "dns-default-metrics-tls" not found Jul 31 14:48:34.277617 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:34.277428 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd777fcbc-spl84: secret "image-registry-tls" not found Jul 31 14:48:34.277617 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:34.277551 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls podName:d9f65952-aa49-4545-b74f-062f5a5d42e7 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:35.277535716 +0000 UTC m=+36.737149090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls") pod "image-registry-5bd777fcbc-spl84" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7") : secret "image-registry-tls" not found Jul 31 14:48:35.202341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:35.202298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7wm6n" event={"ID":"706fdd7b-4f48-4841-9302-a70ccea9d7d8","Type":"ContainerStarted","Data":"df222e3a420298c0e765fd29ce07e78618c2c269ff67614d82b3d1175f9bed00"} Jul 31 14:48:35.205379 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:35.205348 2579 generic.go:356] "Generic (PLEG): container finished" podID="abd693c7-86e2-473d-9233-82d0b4e434ad" containerID="451ee70d35bf36bd0d4f887b4155c11045f9654315e24721d122098adc29ca62" exitCode=0 Jul 31 14:48:35.205487 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:35.205402 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerDied","Data":"451ee70d35bf36bd0d4f887b4155c11045f9654315e24721d122098adc29ca62"} Jul 31 14:48:35.285169 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:35.285139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:35.285286 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:35.285202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:35.285348 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:35.285279 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:35.286195 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:35.285787 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls podName:560b6bef-50d2-4856-ba18-981e1230d6ab nodeName:}" failed. No retries permitted until 2026-07-31 14:48:37.2857676 +0000 UTC m=+38.745380960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls") pod "dns-default-jn8r2" (UID: "560b6bef-50d2-4856-ba18-981e1230d6ab") : secret "dns-default-metrics-tls" not found Jul 31 14:48:35.286195 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:35.285919 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:35.286195 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:35.285960 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd777fcbc-spl84: secret "image-registry-tls" not found Jul 31 14:48:35.286195 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:35.286022 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls podName:d9f65952-aa49-4545-b74f-062f5a5d42e7 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:37.286003665 +0000 UTC m=+38.745617026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls") pod "image-registry-5bd777fcbc-spl84" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7") : secret "image-registry-tls" not found Jul 31 14:48:36.211478 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:36.211441 2579 generic.go:356] "Generic (PLEG): container finished" podID="abd693c7-86e2-473d-9233-82d0b4e434ad" containerID="3dd12dcc82ce76471a7a8d38a9b689dec952029a8034a0cb9e8dc8267348cf3f" exitCode=0 Jul 31 14:48:36.211900 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:36.211502 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerDied","Data":"3dd12dcc82ce76471a7a8d38a9b689dec952029a8034a0cb9e8dc8267348cf3f"} Jul 31 14:48:37.217073 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.216867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" event={"ID":"abd693c7-86e2-473d-9233-82d0b4e434ad","Type":"ContainerStarted","Data":"643a967928c7a02c99665968850be70581c752a8a3d2d18f5769262b378d7f16"} Jul 31 14:48:37.218202 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.218176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7wm6n" event={"ID":"706fdd7b-4f48-4841-9302-a70ccea9d7d8","Type":"ContainerStarted","Data":"c9802969a9805d7a1de30ae46486c0500cf5666b18f1711b99cf3874727b57c6"} Jul 31 14:48:37.251243 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.251193 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hrs6x" podStartSLOduration=8.303642402 podStartE2EDuration="38.251173443s" totalImagesPullingTime="29.947531041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:37.247755617 +0000 UTC m=+38.707368994" watchObservedRunningTime="2026-07-31 14:48:37.251173443 +0000 UTC m=+38.710786822" Jul 31 14:48:37.304285 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.304258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:37.304383 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.304307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:37.304432 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:37.304410 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:37.304432 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:37.304409 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:37.304432 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:37.304421 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd777fcbc-spl84: secret "image-registry-tls" not found Jul 31 14:48:37.304527 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:37.304475 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls podName:560b6bef-50d2-4856-ba18-981e1230d6ab nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.304459398 +0000 UTC m=+42.764072772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls") pod "dns-default-jn8r2" (UID: "560b6bef-50d2-4856-ba18-981e1230d6ab") : secret "dns-default-metrics-tls" not found Jul 31 14:48:37.304527 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:37.304491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls podName:d9f65952-aa49-4545-b74f-062f5a5d42e7 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.304485104 +0000 UTC m=+42.764098489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls") pod "image-registry-5bd777fcbc-spl84" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7") : secret "image-registry-tls" not found Jul 31 14:48:37.310249 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.310217 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7wm6n" podStartSLOduration=1.79362925 podStartE2EDuration="4.310204193s" totalImagesPullingTime="2.516574943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:37.304702698 +0000 UTC m=+38.764316080" watchObservedRunningTime="2026-07-31 14:48:37.310204193 +0000 UTC m=+38.769817598" Jul 31 14:48:37.631507 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.631458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:37.855226 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:37.855186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:38.005977 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:38.005889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:39.117188 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:39.117098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:39.226066 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:39.226035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:39.533243 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:39.533203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:39.622699 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:39.622667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:40.305746 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.305718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:40.399414 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.399376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:40.707788 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.707718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:40.725917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.725890 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94"] Jul 31 14:48:40.766860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.766837 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94"] Jul 31 14:48:40.766967 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.766921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" Jul 31 14:48:40.769810 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.769793 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 31 14:48:40.769904 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.769794 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:40.770890 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.770872 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-c6v2p\"" Jul 31 14:48:40.806619 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.806592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:40.880761 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.880738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:40.928792 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:40.928765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlb78\" (UniqueName: \"kubernetes.io/projected/462e236b-2119-4298-ad5f-92693c0bc669-kube-api-access-tlb78\") pod \"migrator-68bc745d87-ckk94\" (UID: \"462e236b-2119-4298-ad5f-92693c0bc669\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" Jul 31 14:48:41.029719 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.029694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb78\" (UniqueName: \"kubernetes.io/projected/462e236b-2119-4298-ad5f-92693c0bc669-kube-api-access-tlb78\") pod \"migrator-68bc745d87-ckk94\" (UID: \"462e236b-2119-4298-ad5f-92693c0bc669\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" Jul 31 14:48:41.045828 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.045672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:41.048885 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.048860 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlb78\" (UniqueName: \"kubernetes.io/projected/462e236b-2119-4298-ad5f-92693c0bc669-kube-api-access-tlb78\") pod \"migrator-68bc745d87-ckk94\" (UID: \"462e236b-2119-4298-ad5f-92693c0bc669\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" Jul 31 14:48:41.075372 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.075345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" Jul 31 14:48:41.118117 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.118095 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wq62m"] Jul 31 14:48:41.138564 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.138534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.139132 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.139108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wq62m"] Jul 31 14:48:41.142548 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.142005 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 14:48:41.142548 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.142216 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 14:48:41.142548 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.142222 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 14:48:41.142548 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.142262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 14:48:41.142548 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.142512 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lxkp8\"" Jul 31 14:48:41.150824 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.150759 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:41.221310 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.221284 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94"] Jul 31 14:48:41.224643 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:41.224606 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462e236b_2119_4298_ad5f_92693c0bc669.slice/crio-14273734da01d94e1de07ae8f6c399e3d12f93ad35f1ac5983a704444cd42410 WatchSource:0}: Error finding container 14273734da01d94e1de07ae8f6c399e3d12f93ad35f1ac5983a704444cd42410: Status 404 returned error can't find the container with id 14273734da01d94e1de07ae8f6c399e3d12f93ad35f1ac5983a704444cd42410 Jul 31 14:48:41.228559 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.228525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" event={"ID":"462e236b-2119-4298-ad5f-92693c0bc669","Type":"ContainerStarted","Data":"14273734da01d94e1de07ae8f6c399e3d12f93ad35f1ac5983a704444cd42410"} Jul 31 14:48:41.230948 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.230918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1422471-0463-44bf-a678-5d5d39526a53-crio-socket\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.231031 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.230964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.231080 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.231028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlc99\" (UniqueName: \"kubernetes.io/projected/b1422471-0463-44bf-a678-5d5d39526a53-kube-api-access-vlc99\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.231080 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.231055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1422471-0463-44bf-a678-5d5d39526a53-data-volume\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.231080 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.231075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlc99\" (UniqueName: \"kubernetes.io/projected/b1422471-0463-44bf-a678-5d5d39526a53-kube-api-access-vlc99\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1422471-0463-44bf-a678-5d5d39526a53-data-volume\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331402 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331513 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1422471-0463-44bf-a678-5d5d39526a53-crio-socket\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331657 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.831641699 +0000 UTC m=+43.291255067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331700 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331706 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1422471-0463-44bf-a678-5d5d39526a53-data-volume\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331718 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls podName:560b6bef-50d2-4856-ba18-981e1230d6ab nodeName:}" failed. No retries permitted until 2026-07-31 14:48:49.331709497 +0000 UTC m=+50.791322854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls") pod "dns-default-jn8r2" (UID: "560b6bef-50d2-4856-ba18-981e1230d6ab") : secret "dns-default-metrics-tls" not found Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331750 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.83173831 +0000 UTC m=+43.291351666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : configmap "kube-rbac-proxy" not found Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:41.331798 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.331786 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1422471-0463-44bf-a678-5d5d39526a53-crio-socket\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.332210 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331827 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:41.332210 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331835 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd777fcbc-spl84: secret "image-registry-tls" not found Jul 31 14:48:41.332210 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.331863 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls podName:d9f65952-aa49-4545-b74f-062f5a5d42e7 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:49.331856654 +0000 UTC m=+50.791470010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls") pod "image-registry-5bd777fcbc-spl84" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7") : secret "image-registry-tls" not found Jul 31 14:48:41.343947 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.343909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlc99\" (UniqueName: \"kubernetes.io/projected/b1422471-0463-44bf-a678-5d5d39526a53-kube-api-access-vlc99\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.835371 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.835341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.835526 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:41.835405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:41.835526 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.835446 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:41.835526 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.835501 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:42.835483572 +0000 UTC m=+44.295096929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : configmap "kube-rbac-proxy" not found Jul 31 14:48:41.835654 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.835545 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:41.835654 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:41.835593 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:42.835581753 +0000 UTC m=+44.295195110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:42.593537 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.593506 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-zt5k4"] Jul 31 14:48:42.627942 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.627918 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-zt5k4"] Jul 31 14:48:42.628088 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.628021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.631306 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.631284 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 31 14:48:42.632511 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.632491 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 31 14:48:42.632772 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.632756 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 31 14:48:42.632857 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.632776 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cd74r\"" Jul 31 14:48:42.632918 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.632859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 31 14:48:42.636410 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.636388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:42.640429 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.640412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae7710f2-ceea-4714-9e68-c948ed17e336-signing-cabundle\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.640553 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.640536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae7710f2-ceea-4714-9e68-c948ed17e336-signing-key\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.640646 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.640601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b7th\" (UniqueName: \"kubernetes.io/projected/ae7710f2-ceea-4714-9e68-c948ed17e336-kube-api-access-2b7th\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.736993 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.736967 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:42.741072 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.741056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae7710f2-ceea-4714-9e68-c948ed17e336-signing-key\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.741121 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.741088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b7th\" (UniqueName: \"kubernetes.io/projected/ae7710f2-ceea-4714-9e68-c948ed17e336-kube-api-access-2b7th\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.741121 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.741106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae7710f2-ceea-4714-9e68-c948ed17e336-signing-cabundle\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.741615 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.741597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae7710f2-ceea-4714-9e68-c948ed17e336-signing-cabundle\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.743541 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.743525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae7710f2-ceea-4714-9e68-c948ed17e336-signing-key\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.772643 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.772621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b7th\" (UniqueName: \"kubernetes.io/projected/ae7710f2-ceea-4714-9e68-c948ed17e336-kube-api-access-2b7th\") pod \"service-ca-98c88fbb5-zt5k4\" (UID: \"ae7710f2-ceea-4714-9e68-c948ed17e336\") " pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:42.841459 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.841437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:42.841532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.841507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:42.841577 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:42.841560 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:42.841577 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:42.841563 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:42.841637 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:42.841616 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:44.841600144 +0000 UTC m=+46.301213500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : configmap "kube-rbac-proxy" not found Jul 31 14:48:42.841637 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:42.841630 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:44.841623583 +0000 UTC m=+46.301236939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:42.937789 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:42.937734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" Jul 31 14:48:43.122629 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:43.122593 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7710f2_ceea_4714_9e68_c948ed17e336.slice/crio-d419165cf54fe943c15b90cf2bac994d449505cf1b726e528e481a5ae3b42880 WatchSource:0}: Error finding container d419165cf54fe943c15b90cf2bac994d449505cf1b726e528e481a5ae3b42880: Status 404 returned error can't find the container with id d419165cf54fe943c15b90cf2bac994d449505cf1b726e528e481a5ae3b42880 Jul 31 14:48:43.122748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:43.122675 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-zt5k4"] Jul 31 14:48:43.234160 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:43.234073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" event={"ID":"ae7710f2-ceea-4714-9e68-c948ed17e336","Type":"ContainerStarted","Data":"d419165cf54fe943c15b90cf2bac994d449505cf1b726e528e481a5ae3b42880"} Jul 31 14:48:43.665180 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:43.665146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s9npp_abc2fad7-2afc-4376-b4db-d951323d69e8/dns-node-resolver/0.log" Jul 31 14:48:44.020285 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:44.020156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:44.258987 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:44.258959 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-knb6c_4837bfb4-3359-4f71-9550-649536bbf1c6/node-ca/0.log" Jul 31 14:48:44.856438 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:44.856391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:44.856887 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:44.856540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:44.856887 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:44.856575 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:44.856887 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:44.856663 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:44.856887 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:44.856675 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:48.856651087 +0000 UTC m=+50.316264445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:44.856887 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:44.856745 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:48.856732246 +0000 UTC m=+50.316345618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : configmap "kube-rbac-proxy" not found Jul 31 14:48:45.056881 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:45.056856 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wm6n_706fdd7b-4f48-4841-9302-a70ccea9d7d8/serve-healthcheck-canary/0.log" Jul 31 14:48:46.243376 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.243342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" event={"ID":"ae7710f2-ceea-4714-9e68-c948ed17e336","Type":"ContainerStarted","Data":"65bccaeb4d4bcff6edb9c7850513e9536810616ef1d0a7d1e1eb259e1c3f790f"} Jul 31 14:48:46.245216 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.245184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" event={"ID":"462e236b-2119-4298-ad5f-92693c0bc669","Type":"ContainerStarted","Data":"13d54634fa758ab37f264efff66532d9a2fa36b407cd7293ac560fe28de47d97"} Jul 31 14:48:46.245339 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.245236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" event={"ID":"462e236b-2119-4298-ad5f-92693c0bc669","Type":"ContainerStarted","Data":"b29863be0d6ebe4177d698865a464f46908c9a1214d645a1577744a2c1ce399d"} Jul 31 14:48:46.266278 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.266228 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-zt5k4" podStartSLOduration=2.046079526 podStartE2EDuration="4.266208055s" totalImagesPullingTime="2.220128529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:46.264562867 +0000 UTC m=+47.724176242" watchObservedRunningTime="2026-07-31 14:48:46.266208055 +0000 UTC m=+47.725821434" Jul 31 14:48:46.284904 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.284863 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-ckk94" podStartSLOduration=2.171665546 podStartE2EDuration="6.284844731s" totalImagesPullingTime="4.113179185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:46.284614605 +0000 UTC m=+47.744227982" watchObservedRunningTime="2026-07-31 14:48:46.284844731 +0000 UTC m=+47.744458108" Jul 31 14:48:46.806752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.806703 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:46.918087 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:46.918062 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.019811 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:47.019787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.129379 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:47.129314 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.321147 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:47.321062 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.558689 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:47.558664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.855532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:47.855451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.274213 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:48.274134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.724316 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:48.724283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.866960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:48.866912 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.889601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:48.889571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:48.889728 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:48.889624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:48.889766 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:48.889728 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:48.889798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:48.889773 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.889759431 +0000 UTC m=+58.349372791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:48.889798 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:48.889792 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:48.889867 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:48.889844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm podName:b1422471-0463-44bf-a678-5d5d39526a53 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.889826906 +0000 UTC m=+58.349440282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wq62m" (UID: "b1422471-0463-44bf-a678-5d5d39526a53") : configmap "kube-rbac-proxy" not found Jul 31 14:48:49.076068 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:49.076039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:49.393920 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:49.393830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:48:49.393920 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:49.393887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:48:49.394148 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:49.394016 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:49.394148 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:49.394020 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:49.394148 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:49.394037 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd777fcbc-spl84: secret "image-registry-tls" not found Jul 31 14:48:49.394148 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:49.394084 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls podName:560b6bef-50d2-4856-ba18-981e1230d6ab nodeName:}" failed. No retries permitted until 2026-07-31 14:49:05.394064635 +0000 UTC m=+66.853677991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls") pod "dns-default-jn8r2" (UID: "560b6bef-50d2-4856-ba18-981e1230d6ab") : secret "dns-default-metrics-tls" not found Jul 31 14:48:49.394273 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:48:49.394151 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls podName:d9f65952-aa49-4545-b74f-062f5a5d42e7 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:05.394131579 +0000 UTC m=+66.853744938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls") pod "image-registry-5bd777fcbc-spl84" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7") : secret "image-registry-tls" not found Jul 31 14:48:50.222629 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:50.222594 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.320760 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:50.320729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.458443 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:50.458414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.648678 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:50.648650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.746789 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:50.746762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:51.040480 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:51.040445 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:51.444868 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:51.444797 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:52.257544 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:52.257506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:52.357595 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:52.357568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:52.636518 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:52.636485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:53.072622 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:53.072587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:53.169569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:53.169541 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:53.452071 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:53.451982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:53.551160 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:53.551131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:53.651367 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:53.651339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:54.033560 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:54.033516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:54.479750 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:54.479666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:54.581571 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:54.581537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:54.840704 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:54.840677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:55.037218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:55.037194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:55.261544 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:55.261465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:55.402738 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:55.402703 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:55.477113 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:55.477083 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:56.638515 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:56.638479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:56.843505 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:56.843470 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:56.948431 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:56.948359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:56.948431 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:56.948410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:56.948870 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:56.948848 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1422471-0463-44bf-a678-5d5d39526a53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:56.950826 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:56.950808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1422471-0463-44bf-a678-5d5d39526a53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wq62m\" (UID: \"b1422471-0463-44bf-a678-5d5d39526a53\") " pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:57.044642 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.044609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:57.050490 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.050476 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wq62m" Jul 31 14:48:57.170399 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.170373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wq62m"] Jul 31 14:48:57.173776 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:48:57.173754 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1422471_0463_44bf_a678_5d5d39526a53.slice/crio-121d0507c4c993df4c691c159a6fde62c33e0008e7aab6edfb1a0efadb507bd5 WatchSource:0}: Error finding container 121d0507c4c993df4c691c159a6fde62c33e0008e7aab6edfb1a0efadb507bd5: Status 404 returned error can't find the container with id 121d0507c4c993df4c691c159a6fde62c33e0008e7aab6edfb1a0efadb507bd5 Jul 31 14:48:57.240074 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.240026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:57.276136 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.276100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wq62m" event={"ID":"b1422471-0463-44bf-a678-5d5d39526a53","Type":"ContainerStarted","Data":"bee1d78ab4debf04b46cfb05cadde6ca4344242579cf18c480eab2081e878575"} Jul 31 14:48:57.276233 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.276183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wq62m" event={"ID":"b1422471-0463-44bf-a678-5d5d39526a53","Type":"ContainerStarted","Data":"121d0507c4c993df4c691c159a6fde62c33e0008e7aab6edfb1a0efadb507bd5"} Jul 31 14:48:57.454235 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:57.454174 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:58.280748 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:48:58.280722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wq62m" event={"ID":"b1422471-0463-44bf-a678-5d5d39526a53","Type":"ContainerStarted","Data":"c1cceeae83b93ce99b11ee1357517a3b2335dd394d851dfea5b92a967d2d838b"} Jul 31 14:49:00.200320 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:00.200292 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnsmj" Jul 31 14:49:00.289235 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:00.289202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wq62m" event={"ID":"b1422471-0463-44bf-a678-5d5d39526a53","Type":"ContainerStarted","Data":"9569eff41f08bdc80e39706dbc4cc823b681eb68a7611d5a9b371d19181c3915"} Jul 31 14:49:00.313349 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:00.313306 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wq62m" podStartSLOduration=17.305113087 podStartE2EDuration="19.313291008s" totalImagesPullingTime="2.008177921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:48:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:00.312579188 +0000 UTC m=+61.772192565" watchObservedRunningTime="2026-07-31 14:49:00.313291008 +0000 UTC m=+61.772904385" Jul 31 14:49:03.892352 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:03.892312 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bd777fcbc-spl84"] Jul 31 14:49:03.892791 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:03.892528 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" podUID="d9f65952-aa49-4545-b74f-062f5a5d42e7" Jul 31 14:49:03.930769 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:03.930731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:04.015137 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.015103 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8458494497-8kjsc"] Jul 31 14:49:04.017679 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.017659 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.058046 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.058021 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8458494497-8kjsc"] Jul 31 14:49:04.072671 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.072640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:04.099649 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92aadaef-e017-4512-beb1-def48edb20cb-image-registry-private-configuration\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.099736 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-registry-tls\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.099736 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92aadaef-e017-4512-beb1-def48edb20cb-installation-pull-secrets\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.099804 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blf4f\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-kube-api-access-blf4f\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.099842 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92aadaef-e017-4512-beb1-def48edb20cb-ca-trust-extracted\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.099895 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92aadaef-e017-4512-beb1-def48edb20cb-registry-certificates\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.099973 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92aadaef-e017-4512-beb1-def48edb20cb-trusted-ca\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.100032 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.099984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-bound-sa-token\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.182268 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.182204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:04.200533 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92aadaef-e017-4512-beb1-def48edb20cb-registry-certificates\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.200687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92aadaef-e017-4512-beb1-def48edb20cb-trusted-ca\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.200687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-bound-sa-token\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.200687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92aadaef-e017-4512-beb1-def48edb20cb-image-registry-private-configuration\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.200687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-registry-tls\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.200687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92aadaef-e017-4512-beb1-def48edb20cb-installation-pull-secrets\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.200687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blf4f\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-kube-api-access-blf4f\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.201027 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.200732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92aadaef-e017-4512-beb1-def48edb20cb-ca-trust-extracted\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.201314 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.201292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92aadaef-e017-4512-beb1-def48edb20cb-ca-trust-extracted\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.201479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.201458 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92aadaef-e017-4512-beb1-def48edb20cb-registry-certificates\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.202015 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.201994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92aadaef-e017-4512-beb1-def48edb20cb-trusted-ca\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.203357 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.203330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92aadaef-e017-4512-beb1-def48edb20cb-installation-pull-secrets\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.203498 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.203476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92aadaef-e017-4512-beb1-def48edb20cb-image-registry-private-configuration\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.203577 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.203561 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-registry-tls\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.214035 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.214012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blf4f\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-kube-api-access-blf4f\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.214261 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.214245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92aadaef-e017-4512-beb1-def48edb20cb-bound-sa-token\") pod \"image-registry-8458494497-8kjsc\" (UID: \"92aadaef-e017-4512-beb1-def48edb20cb\") " pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.303037 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.303014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:49:04.308820 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.308802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:49:04.329063 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.329039 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m7lrf\"" Jul 31 14:49:04.337249 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.337230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:04.350660 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.350635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:04.402170 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402145 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-certificates\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402309 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402183 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-installation-pull-secrets\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402309 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402239 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-image-registry-private-configuration\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402309 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402290 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd6b4\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-kube-api-access-fd6b4\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402463 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402318 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-bound-sa-token\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402463 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402360 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9f65952-aa49-4545-b74f-062f5a5d42e7-ca-trust-extracted\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402463 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402383 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-trusted-ca\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:04.402871 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402732 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:49:04.402871 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.402825 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9f65952-aa49-4545-b74f-062f5a5d42e7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:49:04.403047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.403008 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:49:04.404791 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.404769 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:49:04.404791 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.404770 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:49:04.405012 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.404875 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-kube-api-access-fd6b4" (OuterVolumeSpecName: "kube-api-access-fd6b4") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "kube-api-access-fd6b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:49:04.405053 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.405030 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:49:04.475826 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.475755 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8458494497-8kjsc"] Jul 31 14:49:04.478325 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:04.478302 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92aadaef_e017_4512_beb1_def48edb20cb.slice/crio-b2a70d69eb717fea37ffe599b1f72eedb7797be535310269795e6d226e1ba50a WatchSource:0}: Error finding container b2a70d69eb717fea37ffe599b1f72eedb7797be535310269795e6d226e1ba50a: Status 404 returned error can't find the container with id b2a70d69eb717fea37ffe599b1f72eedb7797be535310269795e6d226e1ba50a Jul 31 14:49:04.503212 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503193 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd6b4\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-kube-api-access-fd6b4\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.503212 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503214 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-bound-sa-token\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.503321 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503223 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9f65952-aa49-4545-b74f-062f5a5d42e7-ca-trust-extracted\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.503321 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503231 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-trusted-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.503321 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503240 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-certificates\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.503321 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503248 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-installation-pull-secrets\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.503321 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.503257 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9f65952-aa49-4545-b74f-062f5a5d42e7-image-registry-private-configuration\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:04.805432 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.805401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:49:04.809096 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.809075 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:49:04.818135 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.818115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b-metrics-certs\") pod \"network-metrics-daemon-bcwrf\" (UID: \"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b\") " pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:49:04.905855 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.905827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:49:04.906230 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.905871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:49:04.908904 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.908879 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:49:04.909043 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.908888 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:49:04.918182 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.918167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6cc103b-7120-4a5e-98a5-c36a675afd9a-original-pull-secret\") pod \"global-pull-secret-syncer-268vx\" (UID: \"c6cc103b-7120-4a5e-98a5-c36a675afd9a\") " pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:49:04.918675 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.918662 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:49:04.929012 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.928998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6jf8\" (UniqueName: \"kubernetes.io/projected/f7b865db-d41b-4716-ae2b-3c442726bc38-kube-api-access-b6jf8\") pod \"network-check-target-d8rt9\" (UID: \"f7b865db-d41b-4716-ae2b-3c442726bc38\") " pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:49:04.949609 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.949591 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ljf7\"" Jul 31 14:49:04.951806 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.951791 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-268vx" Jul 31 14:49:04.956950 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.956923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:49:04.959386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.959372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-262fz\"" Jul 31 14:49:04.967953 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:04.967924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcwrf" Jul 31 14:49:05.108851 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.108825 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-268vx"] Jul 31 14:49:05.111668 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:05.111645 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cc103b_7120_4a5e_98a5_c36a675afd9a.slice/crio-e5581f09251a97ab69c0db62f2f4b8e66a342280ad94d9d31ee8097f815d1cdf WatchSource:0}: Error finding container e5581f09251a97ab69c0db62f2f4b8e66a342280ad94d9d31ee8097f815d1cdf: Status 404 returned error can't find the container with id e5581f09251a97ab69c0db62f2f4b8e66a342280ad94d9d31ee8097f815d1cdf Jul 31 14:49:05.308078 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.308046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-268vx" event={"ID":"c6cc103b-7120-4a5e-98a5-c36a675afd9a","Type":"ContainerStarted","Data":"e5581f09251a97ab69c0db62f2f4b8e66a342280ad94d9d31ee8097f815d1cdf"} Jul 31 14:49:05.310113 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.310075 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:49:05.310113 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.310102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8458494497-8kjsc" event={"ID":"92aadaef-e017-4512-beb1-def48edb20cb","Type":"ContainerStarted","Data":"2f68fce73a5d746813f832f0d990dfa81f029b807d083abe4a5d6d92658ceb12"} Jul 31 14:49:05.310273 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.310155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8458494497-8kjsc" event={"ID":"92aadaef-e017-4512-beb1-def48edb20cb","Type":"ContainerStarted","Data":"b2a70d69eb717fea37ffe599b1f72eedb7797be535310269795e6d226e1ba50a"} Jul 31 14:49:05.310505 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.310485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:05.340593 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.340570 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d8rt9"] Jul 31 14:49:05.341861 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:05.341842 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b865db_d41b_4716_ae2b_3c442726bc38.slice/crio-4c6144f78ea3f46ce2466aea61761221a86466855fa401d861c97b4c7635fb0c WatchSource:0}: Error finding container 4c6144f78ea3f46ce2466aea61761221a86466855fa401d861c97b4c7635fb0c: Status 404 returned error can't find the container with id 4c6144f78ea3f46ce2466aea61761221a86466855fa401d861c97b4c7635fb0c Jul 31 14:49:05.345690 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.345669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcwrf"] Jul 31 14:49:05.345861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.345816 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8458494497-8kjsc" podStartSLOduration=2.345796125 podStartE2EDuration="2.345796125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:05.343338093 +0000 UTC m=+66.802951470" watchObservedRunningTime="2026-07-31 14:49:05.345796125 +0000 UTC m=+66.805409503" Jul 31 14:49:05.347701 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:05.347680 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9974ba4e_3f44_4a3b_a0d7_ccd4ac1c1f9b.slice/crio-4e5dca0d0c6cec960ed14976d15ba3ccd4fdb45768e469360971aeac5d49ba72 WatchSource:0}: Error finding container 4e5dca0d0c6cec960ed14976d15ba3ccd4fdb45768e469360971aeac5d49ba72: Status 404 returned error can't find the container with id 4e5dca0d0c6cec960ed14976d15ba3ccd4fdb45768e469360971aeac5d49ba72 Jul 31 14:49:05.390223 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.390191 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bd777fcbc-spl84"] Jul 31 14:49:05.395135 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.395116 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bd777fcbc-spl84"] Jul 31 14:49:05.409593 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.409568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:49:05.409771 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.409753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:49:05.412137 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.412106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/560b6bef-50d2-4856-ba18-981e1230d6ab-metrics-tls\") pod \"dns-default-jn8r2\" (UID: \"560b6bef-50d2-4856-ba18-981e1230d6ab\") " pod="openshift-dns/dns-default-jn8r2" Jul 31 14:49:05.412251 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.412233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"image-registry-5bd777fcbc-spl84\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " pod="openshift-image-registry/image-registry-5bd777fcbc-spl84" Jul 31 14:49:05.510209 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.510186 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") pod \"d9f65952-aa49-4545-b74f-062f5a5d42e7\" (UID: \"d9f65952-aa49-4545-b74f-062f5a5d42e7\") " Jul 31 14:49:05.512045 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.512026 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d9f65952-aa49-4545-b74f-062f5a5d42e7" (UID: "d9f65952-aa49-4545-b74f-062f5a5d42e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:49:05.611591 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.611534 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9f65952-aa49-4545-b74f-062f5a5d42e7-registry-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:49:05.623261 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.623231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:05.670168 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.670144 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4w6d9\"" Jul 31 14:49:05.677617 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.677597 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jn8r2" Jul 31 14:49:05.718074 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.718043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:05.837845 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:05.837817 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jn8r2"] Jul 31 14:49:05.841840 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:05.841809 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560b6bef_50d2_4856_ba18_981e1230d6ab.slice/crio-7e534fe215bd7b82d20c31c2c6b3af7d5d285427443d5a2c23ad8ff4d90ef7ea WatchSource:0}: Error finding container 7e534fe215bd7b82d20c31c2c6b3af7d5d285427443d5a2c23ad8ff4d90ef7ea: Status 404 returned error can't find the container with id 7e534fe215bd7b82d20c31c2c6b3af7d5d285427443d5a2c23ad8ff4d90ef7ea Jul 31 14:49:06.317820 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.317779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d8rt9" event={"ID":"f7b865db-d41b-4716-ae2b-3c442726bc38","Type":"ContainerStarted","Data":"4c6144f78ea3f46ce2466aea61761221a86466855fa401d861c97b4c7635fb0c"} Jul 31 14:49:06.322238 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.322206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jn8r2" event={"ID":"560b6bef-50d2-4856-ba18-981e1230d6ab","Type":"ContainerStarted","Data":"7e534fe215bd7b82d20c31c2c6b3af7d5d285427443d5a2c23ad8ff4d90ef7ea"} Jul 31 14:49:06.325077 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.324688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcwrf" event={"ID":"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b","Type":"ContainerStarted","Data":"4e5dca0d0c6cec960ed14976d15ba3ccd4fdb45768e469360971aeac5d49ba72"} Jul 31 14:49:06.366925 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.366792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:06.475852 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.475773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:06.575919 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.575882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:06.593218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.593187 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9"] Jul 31 14:49:06.602183 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.602161 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:06.606731 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.606287 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-89zlx\"" Jul 31 14:49:06.606731 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.606527 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 31 14:49:06.610317 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.610263 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9"] Jul 31 14:49:06.720414 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.720309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b9107920-90ed-4dc3-a6bf-4254ab27d241-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-n64h9\" (UID: \"b9107920-90ed-4dc3-a6bf-4254ab27d241\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:06.785675 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.785607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:06.822320 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.821711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b9107920-90ed-4dc3-a6bf-4254ab27d241-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-n64h9\" (UID: \"b9107920-90ed-4dc3-a6bf-4254ab27d241\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:06.834058 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.834003 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b9107920-90ed-4dc3-a6bf-4254ab27d241-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-n64h9\" (UID: \"b9107920-90ed-4dc3-a6bf-4254ab27d241\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:06.915827 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:06.915795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:07.044063 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:07.043788 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9f65952-aa49-4545-b74f-062f5a5d42e7" path="/var/lib/kubelet/pods/d9f65952-aa49-4545-b74f-062f5a5d42e7/volumes" Jul 31 14:49:07.096120 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:07.096086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9"] Jul 31 14:49:07.156365 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:07.156327 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9107920_90ed_4dc3_a6bf_4254ab27d241.slice/crio-bc822b55b800622b03b1d0d851c34104af77fb54d5d4ca6582fca9d89bcbf1c3 WatchSource:0}: Error finding container bc822b55b800622b03b1d0d851c34104af77fb54d5d4ca6582fca9d89bcbf1c3: Status 404 returned error can't find the container with id bc822b55b800622b03b1d0d851c34104af77fb54d5d4ca6582fca9d89bcbf1c3 Jul 31 14:49:07.332828 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:07.332248 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcwrf" event={"ID":"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b","Type":"ContainerStarted","Data":"1b5e0ef5cd41ffd94cdf353687bd245ac87ac3822094a4575b539fb442fabefc"} Jul 31 14:49:07.334399 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:07.334343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" event={"ID":"b9107920-90ed-4dc3-a6bf-4254ab27d241","Type":"ContainerStarted","Data":"bc822b55b800622b03b1d0d851c34104af77fb54d5d4ca6582fca9d89bcbf1c3"} Jul 31 14:49:10.022658 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:10.022621 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:10.151314 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:10.151271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:11.349685 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.349644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" event={"ID":"b9107920-90ed-4dc3-a6bf-4254ab27d241","Type":"ContainerStarted","Data":"32d3ca8d8dca85df9c5b13a8b6a45613e89f4fe96432df7759ba5a819997cab5"} Jul 31 14:49:11.350196 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.349789 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:11.351377 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.351351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d8rt9" event={"ID":"f7b865db-d41b-4716-ae2b-3c442726bc38","Type":"ContainerStarted","Data":"4ce72d6c172e37936d41c7e5141a292a9258d9fa291f6c62a102d16b18b4f956"} Jul 31 14:49:11.351503 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.351459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:49:11.353277 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.353256 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-268vx" event={"ID":"c6cc103b-7120-4a5e-98a5-c36a675afd9a","Type":"ContainerStarted","Data":"b0a36c95120eab61dbd797a9a8e90553071e787f85c2a468ca38a5a9c3c87fd8"} Jul 31 14:49:11.355445 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.355427 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" Jul 31 14:49:11.355604 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.355586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jn8r2" event={"ID":"560b6bef-50d2-4856-ba18-981e1230d6ab","Type":"ContainerStarted","Data":"e8e898f796b1aeb7bc55527eeb73f2a0a6ffd187ce4110b8ce67b848c0563853"} Jul 31 14:49:11.355686 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.355632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jn8r2" event={"ID":"560b6bef-50d2-4856-ba18-981e1230d6ab","Type":"ContainerStarted","Data":"24d058d7c9f129eda6ed727e25620d946445052d196fc59ccdeeca93fe7f6b5f"} Jul 31 14:49:11.355686 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.355655 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jn8r2" Jul 31 14:49:11.357201 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.357173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcwrf" event={"ID":"9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b","Type":"ContainerStarted","Data":"27aac9df1f966bf4586b9be5ed9084aef734891efa8c4f98bdf6f47198ec828e"} Jul 31 14:49:11.366572 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.366534 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-n64h9" podStartSLOduration=1.9037792040000001 podStartE2EDuration="5.366519951s" totalImagesPullingTime="3.462740747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:11.366271089 +0000 UTC m=+72.825884469" watchObservedRunningTime="2026-07-31 14:49:11.366519951 +0000 UTC m=+72.826133330" Jul 31 14:49:11.402843 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.402805 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jn8r2" podStartSLOduration=33.654189982 podStartE2EDuration="38.402790725s" totalImagesPullingTime="4.748600743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:11.402381475 +0000 UTC m=+72.861994854" watchObservedRunningTime="2026-07-31 14:49:11.402790725 +0000 UTC m=+72.862404103" Jul 31 14:49:11.420761 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.420723 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-268vx" podStartSLOduration=66.9413157 podStartE2EDuration="1m12.420709822s" totalImagesPullingTime="5.479394122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:11.41939822 +0000 UTC m=+72.879011598" watchObservedRunningTime="2026-07-31 14:49:11.420709822 +0000 UTC m=+72.880323200" Jul 31 14:49:11.441489 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.441451 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bcwrf" podStartSLOduration=70.62223973 podStartE2EDuration="1m12.441438719s" totalImagesPullingTime="1.819198989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:11.440589403 +0000 UTC m=+72.900202781" watchObservedRunningTime="2026-07-31 14:49:11.441438719 +0000 UTC m=+72.901052097" Jul 31 14:49:11.458581 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.458543 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d8rt9" podStartSLOduration=67.21081928 podStartE2EDuration="1m12.458530216s" totalImagesPullingTime="5.247710936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:11.457627376 +0000 UTC m=+72.917240756" watchObservedRunningTime="2026-07-31 14:49:11.458530216 +0000 UTC m=+72.918143593" Jul 31 14:49:11.544862 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.544823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:11.647282 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.647219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:11.662162 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.662137 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4txrr"] Jul 31 14:49:11.664101 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.664086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.667869 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.667842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 31 14:49:11.667988 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.667892 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 14:49:11.667988 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.667903 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 31 14:49:11.667988 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.667968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-khc6k\"" Jul 31 14:49:11.668158 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.667892 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 14:49:11.668158 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.668124 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 14:49:11.676740 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.676719 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4txrr"] Jul 31 14:49:11.750134 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.750103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:11.760172 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.760149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.760262 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.760181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.760262 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.760203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8551fdfd-55be-4795-aaa5-c3842e8e59bb-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.760360 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.760309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj2mw\" (UniqueName: \"kubernetes.io/projected/8551fdfd-55be-4795-aaa5-c3842e8e59bb-kube-api-access-vj2mw\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.861004 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.860979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj2mw\" (UniqueName: \"kubernetes.io/projected/8551fdfd-55be-4795-aaa5-c3842e8e59bb-kube-api-access-vj2mw\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.861085 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.861020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.861085 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.861038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.861085 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.861057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8551fdfd-55be-4795-aaa5-c3842e8e59bb-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.861207 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:11.861135 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 31 14:49:11.861207 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:11.861202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-tls podName:8551fdfd-55be-4795-aaa5-c3842e8e59bb nodeName:}" failed. No retries permitted until 2026-07-31 14:49:12.361183439 +0000 UTC m=+73.820796795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-4txrr" (UID: "8551fdfd-55be-4795-aaa5-c3842e8e59bb") : secret "prometheus-operator-tls" not found Jul 31 14:49:11.861815 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.861748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8551fdfd-55be-4795-aaa5-c3842e8e59bb-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.863508 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.863490 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.870492 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.870472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj2mw\" (UniqueName: \"kubernetes.io/projected/8551fdfd-55be-4795-aaa5-c3842e8e59bb-kube-api-access-vj2mw\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:11.955958 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:11.955868 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:12.363094 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:12.363068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:12.365484 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:12.365461 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8551fdfd-55be-4795-aaa5-c3842e8e59bb-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4txrr\" (UID: \"8551fdfd-55be-4795-aaa5-c3842e8e59bb\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:12.573551 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:12.573516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" Jul 31 14:49:12.699587 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:12.699557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4txrr"] Jul 31 14:49:12.702241 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:12.702210 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8551fdfd_55be_4795_aaa5_c3842e8e59bb.slice/crio-4d636e2451010186448167a2f2d9e4ff08eb7efb341d6a23b777ddec648dbfe1 WatchSource:0}: Error finding container 4d636e2451010186448167a2f2d9e4ff08eb7efb341d6a23b777ddec648dbfe1: Status 404 returned error can't find the container with id 4d636e2451010186448167a2f2d9e4ff08eb7efb341d6a23b777ddec648dbfe1 Jul 31 14:49:13.366232 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:13.366199 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" event={"ID":"8551fdfd-55be-4795-aaa5-c3842e8e59bb","Type":"ContainerStarted","Data":"4d636e2451010186448167a2f2d9e4ff08eb7efb341d6a23b777ddec648dbfe1"} Jul 31 14:49:14.252191 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:14.252140 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:14.371179 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:14.371142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" event={"ID":"8551fdfd-55be-4795-aaa5-c3842e8e59bb","Type":"ContainerStarted","Data":"cb867b286ff8120573d4dfa0e83188f0503263e600bf2635a75e6f6908359116"} Jul 31 14:49:14.371546 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:14.371241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" event={"ID":"8551fdfd-55be-4795-aaa5-c3842e8e59bb","Type":"ContainerStarted","Data":"575b670d831bc04f1a5a80137daa408cacf7d2f90e1437e96f8d1b7e2d8ceef7"} Jul 31 14:49:15.866291 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:15.866250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:16.139961 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.139869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:16.160842 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.160796 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-4txrr" podStartSLOduration=4.099031638 podStartE2EDuration="5.160780317s" totalImagesPullingTime="1.061748679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:14.397097757 +0000 UTC m=+75.856711126" watchObservedRunningTime="2026-07-31 14:49:16.160780317 +0000 UTC m=+77.620393694" Jul 31 14:49:16.161104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.161086 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg"] Jul 31 14:49:16.163410 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.163392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.169536 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.169514 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 31 14:49:16.170895 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.170877 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dfn5b\"" Jul 31 14:49:16.171066 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.170914 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 31 14:49:16.171129 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.170960 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 31 14:49:16.180328 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.180308 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9"] Jul 31 14:49:16.182348 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.182335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.189396 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.189345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 31 14:49:16.196281 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.196259 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg"] Jul 31 14:49:16.200202 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.200184 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 31 14:49:16.201992 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.201975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5g55b\"" Jul 31 14:49:16.204040 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.204024 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9"] Jul 31 14:49:16.246144 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.246124 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ksfcc"] Jul 31 14:49:16.248991 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.248968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.251755 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.251739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 14:49:16.251925 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.251785 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 14:49:16.252018 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.251810 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t7hpg\"" Jul 31 14:49:16.252098 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.252083 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 14:49:16.292121 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c3766b-63e7-4c07-b9bb-705967894804-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.292219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.292219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.292318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdstw\" (UniqueName: \"kubernetes.io/projected/17c3766b-63e7-4c07-b9bb-705967894804-kube-api-access-mdstw\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.292318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f783aa-e1c5-4cac-9b07-984020e95f99-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.292318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.292318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpx9m\" (UniqueName: \"kubernetes.io/projected/37f783aa-e1c5-4cac-9b07-984020e95f99-kube-api-access-bpx9m\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.292500 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.292500 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.292500 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.292443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17c3766b-63e7-4c07-b9bb-705967894804-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.307055 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.307029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:16.393233 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.393233 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.393379 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdstw\" (UniqueName: \"kubernetes.io/projected/17c3766b-63e7-4c07-b9bb-705967894804-kube-api-access-mdstw\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.393379 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-tls\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.393379 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f783aa-e1c5-4cac-9b07-984020e95f99-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.393532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.393532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-textfile\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.393532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpx9m\" (UniqueName: \"kubernetes.io/projected/37f783aa-e1c5-4cac-9b07-984020e95f99-kube-api-access-bpx9m\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.393532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-root\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.393727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-wtmp\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.393727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.393727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvwr\" (UniqueName: \"kubernetes.io/projected/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-kube-api-access-rlvwr\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.393727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-sys\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-metrics-client-ca\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17c3766b-63e7-4c07-b9bb-705967894804-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:16.393920 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.393955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c3766b-63e7-4c07-b9bb-705967894804-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:16.394041 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-tls podName:37f783aa-e1c5-4cac-9b07-984020e95f99 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:16.8940239 +0000 UTC m=+78.353637262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-7dcj9" (UID: "37f783aa-e1c5-4cac-9b07-984020e95f99") : secret "openshift-state-metrics-tls" not found Jul 31 14:49:16.394103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.394038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f783aa-e1c5-4cac-9b07-984020e95f99-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.394571 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:16.394135 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 31 14:49:16.394571 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:49:16.394188 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-tls podName:17c3766b-63e7-4c07-b9bb-705967894804 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:16.894172735 +0000 UTC m=+78.353786098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-q8zhg" (UID: "17c3766b-63e7-4c07-b9bb-705967894804") : secret "kube-state-metrics-tls" not found Jul 31 14:49:16.394571 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.394474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.394571 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.394493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17c3766b-63e7-4c07-b9bb-705967894804-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.394571 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.394563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c3766b-63e7-4c07-b9bb-705967894804-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.396102 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.396080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.396640 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.396624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.409262 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.409241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpx9m\" (UniqueName: \"kubernetes.io/projected/37f783aa-e1c5-4cac-9b07-984020e95f99-kube-api-access-bpx9m\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.411314 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.411297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdstw\" (UniqueName: \"kubernetes.io/projected/17c3766b-63e7-4c07-b9bb-705967894804-kube-api-access-mdstw\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.461397 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.461371 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:16.494636 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-textfile\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-root\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-wtmp\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494727 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvwr\" (UniqueName: \"kubernetes.io/projected/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-kube-api-access-rlvwr\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494931 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-root\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494931 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494931 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-sys\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494931 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-wtmp\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.494931 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-metrics-client-ca\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.495204 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.494931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-tls\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.495204 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.495061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-sys\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.495304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.495267 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-textfile\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.495657 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.495628 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.495745 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.495730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-metrics-client-ca\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.497249 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.497224 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.497564 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.497544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-node-exporter-tls\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.507652 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.507624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvwr\" (UniqueName: \"kubernetes.io/projected/85aa8594-3c6a-4811-b980-0f85ad6ea5cd-kube-api-access-rlvwr\") pod \"node-exporter-ksfcc\" (UID: \"85aa8594-3c6a-4811-b980-0f85ad6ea5cd\") " pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.560458 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.560437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ksfcc" Jul 31 14:49:16.575544 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:16.575522 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85aa8594_3c6a_4811_b980_0f85ad6ea5cd.slice/crio-fa8b3b9a68d178160e8f5b4cbde46577b26b819f193169a90fa64bbf7cf83698 WatchSource:0}: Error finding container fa8b3b9a68d178160e8f5b4cbde46577b26b819f193169a90fa64bbf7cf83698: Status 404 returned error can't find the container with id fa8b3b9a68d178160e8f5b4cbde46577b26b819f193169a90fa64bbf7cf83698 Jul 31 14:49:16.598212 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.598188 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:16.700783 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.700683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:16.898205 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.898175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.898555 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.898211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.900662 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.900633 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3766b-63e7-4c07-b9bb-705967894804-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-q8zhg\" (UID: \"17c3766b-63e7-4c07-b9bb-705967894804\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:16.900766 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.900640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f783aa-e1c5-4cac-9b07-984020e95f99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7dcj9\" (UID: \"37f783aa-e1c5-4cac-9b07-984020e95f99\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:16.994250 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:16.994181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:17.073249 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.073214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" Jul 31 14:49:17.092309 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.092277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" Jul 31 14:49:17.124431 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.124395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:17.242194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.242100 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg"] Jul 31 14:49:17.247801 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:17.247773 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c3766b_63e7_4c07_b9bb_705967894804.slice/crio-4d5ea8d584cf46505dc54261432cb3179d90e35ae1a6455c3ad6eaef4cbb187d WatchSource:0}: Error finding container 4d5ea8d584cf46505dc54261432cb3179d90e35ae1a6455c3ad6eaef4cbb187d: Status 404 returned error can't find the container with id 4d5ea8d584cf46505dc54261432cb3179d90e35ae1a6455c3ad6eaef4cbb187d Jul 31 14:49:17.262003 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.261919 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9"] Jul 31 14:49:17.264237 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:17.264216 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f783aa_e1c5_4cac_9b07_984020e95f99.slice/crio-0fb42a421b8e31925d310a38786eb77696666d4c0df84b5021fc287f841cb1d1 WatchSource:0}: Error finding container 0fb42a421b8e31925d310a38786eb77696666d4c0df84b5021fc287f841cb1d1: Status 404 returned error can't find the container with id 0fb42a421b8e31925d310a38786eb77696666d4c0df84b5021fc287f841cb1d1 Jul 31 14:49:17.286799 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.286616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:17.387038 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.383334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" event={"ID":"17c3766b-63e7-4c07-b9bb-705967894804","Type":"ContainerStarted","Data":"4d5ea8d584cf46505dc54261432cb3179d90e35ae1a6455c3ad6eaef4cbb187d"} Jul 31 14:49:17.387038 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.385252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" event={"ID":"37f783aa-e1c5-4cac-9b07-984020e95f99","Type":"ContainerStarted","Data":"819e95247d91afd303d3d122cd22a8788da3b026131bed30497997c730efea28"} Jul 31 14:49:17.387038 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.385301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" event={"ID":"37f783aa-e1c5-4cac-9b07-984020e95f99","Type":"ContainerStarted","Data":"0fb42a421b8e31925d310a38786eb77696666d4c0df84b5021fc287f841cb1d1"} Jul 31 14:49:17.387038 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.386496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksfcc" event={"ID":"85aa8594-3c6a-4811-b980-0f85ad6ea5cd","Type":"ContainerStarted","Data":"fa8b3b9a68d178160e8f5b4cbde46577b26b819f193169a90fa64bbf7cf83698"} Jul 31 14:49:17.389768 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.389708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:17.447173 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.445046 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:49:17.448979 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.448929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.455814 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.455790 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.456281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.456472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.456638 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.456815 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-btx28\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.457055 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.457286 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.457472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 14:49:17.457968 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.457677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 14:49:17.458642 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.458625 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 14:49:17.476801 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.476778 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:49:17.502521 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-web-config\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502521 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw54d\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-kube-api-access-bw54d\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502698 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-volume\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502698 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502698 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502698 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502906 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502906 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.502906 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.503089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.503089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.503089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.502981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-out\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.503089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.503011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.524334 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.523764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:17.603308 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603417 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603417 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-out\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603626 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603709 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-web-config\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603709 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw54d\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-kube-api-access-bw54d\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603812 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-volume\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603812 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603812 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.603812 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.604046 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.604046 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.604046 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.603912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.607050 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.604259 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.607050 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.605577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.607050 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.605836 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.607050 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.606509 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.607050 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.606911 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.607431 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.607229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-out\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.608254 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.607755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.608254 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.608205 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-web-config\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.609641 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.609616 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-volume\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.610552 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.610526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.610643 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.610551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.610643 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.610623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.623032 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.623014 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw54d\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-kube-api-access-bw54d\") pod \"alertmanager-main-0\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.710849 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.710816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:17.762551 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.762490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:49:17.929530 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:17.929505 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:49:17.930527 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:17.930495 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9d3dba_9d68_4023_9e27_9f05941bec01.slice/crio-e29e7370d95325fcd75166d8c73c290b5df7050e14d1378fd0e8ac9922aaa231 WatchSource:0}: Error finding container e29e7370d95325fcd75166d8c73c290b5df7050e14d1378fd0e8ac9922aaa231: Status 404 returned error can't find the container with id e29e7370d95325fcd75166d8c73c290b5df7050e14d1378fd0e8ac9922aaa231 Jul 31 14:49:18.390514 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:18.390464 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"e29e7370d95325fcd75166d8c73c290b5df7050e14d1378fd0e8ac9922aaa231"} Jul 31 14:49:18.392218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:18.392193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" event={"ID":"37f783aa-e1c5-4cac-9b07-984020e95f99","Type":"ContainerStarted","Data":"4f8dd5ddc7aaadebf36f715d2473ed6c33c46155729178fcfa2f873461b3b497"} Jul 31 14:49:18.393615 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:18.393590 2579 generic.go:356] "Generic (PLEG): container finished" podID="85aa8594-3c6a-4811-b980-0f85ad6ea5cd" containerID="4948f812807339a4ef5a6df302bff2589b699669378153645c2005ac769240c0" exitCode=0 Jul 31 14:49:18.393684 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:18.393659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksfcc" event={"ID":"85aa8594-3c6a-4811-b980-0f85ad6ea5cd","Type":"ContainerDied","Data":"4948f812807339a4ef5a6df302bff2589b699669378153645c2005ac769240c0"} Jul 31 14:49:19.268606 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.268562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:19.368484 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.368450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:19.400043 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.400003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" event={"ID":"17c3766b-63e7-4c07-b9bb-705967894804","Type":"ContainerStarted","Data":"e64c9dc2fa252c24dbcc53dbecc330ffc19a0035e6b6ad668a8a9ceb272b4512"} Jul 31 14:49:19.400147 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.400079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" event={"ID":"17c3766b-63e7-4c07-b9bb-705967894804","Type":"ContainerStarted","Data":"64558fd9e8ff72c0777840815941292ae842fb0e7dd7690caa2b335e3579304e"} Jul 31 14:49:19.400147 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.400107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" event={"ID":"17c3766b-63e7-4c07-b9bb-705967894804","Type":"ContainerStarted","Data":"427ff8f00bc88b1ef64348cb78d1510b3da81b5ac14e9a3f51976a74bfb366f5"} Jul 31 14:49:19.402236 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.402209 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5" exitCode=0 Jul 31 14:49:19.402340 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.402299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5"} Jul 31 14:49:19.404529 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.404481 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" event={"ID":"37f783aa-e1c5-4cac-9b07-984020e95f99","Type":"ContainerStarted","Data":"cdec6cc57e0d46d7defcd50a1dc00ab62870a96279138acc86e2133ef8fd085e"} Jul 31 14:49:19.407386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.407363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksfcc" event={"ID":"85aa8594-3c6a-4811-b980-0f85ad6ea5cd","Type":"ContainerStarted","Data":"6aa3d773e47250710ad8f04ed4af68487a3e2ce191e5dd76b200939206a77836"} Jul 31 14:49:19.407480 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.407411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksfcc" event={"ID":"85aa8594-3c6a-4811-b980-0f85ad6ea5cd","Type":"ContainerStarted","Data":"a9b7f8d50ca4cccad08de7b38017f40f4855703c378bb3aa7a95cf19498ac637"} Jul 31 14:49:19.424884 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.424849 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-q8zhg" podStartSLOduration=2.290067223 podStartE2EDuration="3.424836301s" totalImagesPullingTime="1.134769078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:19.423198136 +0000 UTC m=+80.882811514" watchObservedRunningTime="2026-07-31 14:49:19.424836301 +0000 UTC m=+80.884449682" Jul 31 14:49:19.450438 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.450394 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7dcj9" podStartSLOduration=1.847213912 podStartE2EDuration="3.450379806s" totalImagesPullingTime="1.603165894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:19.449329271 +0000 UTC m=+80.908942648" watchObservedRunningTime="2026-07-31 14:49:19.450379806 +0000 UTC m=+80.909993184" Jul 31 14:49:19.510308 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.510243 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ksfcc" podStartSLOduration=2.408428044 podStartE2EDuration="3.510221868s" totalImagesPullingTime="1.018877917s" totalInitContainerRuntime="82.915907ms" isStatefulPod=true podCreationTimestamp="2026-07-31 14:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:19.476923899 +0000 UTC m=+80.936537276" watchObservedRunningTime="2026-07-31 14:49:19.510221868 +0000 UTC m=+80.969835245" Jul 31 14:49:19.768646 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.768602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:19.904998 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:19.904925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:20.703409 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.703380 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55b885979c-7jbf5"] Jul 31 14:49:20.706487 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.706467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.711619 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.711601 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 31 14:49:20.711619 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.711613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 31 14:49:20.711791 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.711673 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-50o6bovhcbga\"" Jul 31 14:49:20.712333 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.712312 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 14:49:20.712643 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.712453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-npjhj\"" Jul 31 14:49:20.715035 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.715017 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 31 14:49:20.728738 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.725971 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55b885979c-7jbf5"] Jul 31 14:49:20.837381 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3138f33c-618d-477f-a525-768015287d68-audit-log\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.837479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3138f33c-618d-477f-a525-768015287d68-metrics-server-audit-profiles\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.837479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kq4r\" (UniqueName: \"kubernetes.io/projected/3138f33c-618d-477f-a525-768015287d68-kube-api-access-6kq4r\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.837606 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-secret-metrics-server-client-certs\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.837606 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-secret-metrics-server-tls\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.837713 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-client-ca-bundle\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.837713 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.837656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3138f33c-618d-477f-a525-768015287d68-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938129 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3138f33c-618d-477f-a525-768015287d68-metrics-server-audit-profiles\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kq4r\" (UniqueName: \"kubernetes.io/projected/3138f33c-618d-477f-a525-768015287d68-kube-api-access-6kq4r\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-secret-metrics-server-client-certs\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-secret-metrics-server-tls\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938354 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-client-ca-bundle\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938687 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3138f33c-618d-477f-a525-768015287d68-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.938771 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.938730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3138f33c-618d-477f-a525-768015287d68-audit-log\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.939167 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.939146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3138f33c-618d-477f-a525-768015287d68-audit-log\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.939351 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.939330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3138f33c-618d-477f-a525-768015287d68-metrics-server-audit-profiles\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.939539 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.939487 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3138f33c-618d-477f-a525-768015287d68-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.940877 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.940845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-secret-metrics-server-client-certs\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.941098 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.941061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-secret-metrics-server-tls\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.941289 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.941272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3138f33c-618d-477f-a525-768015287d68-client-ca-bundle\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:20.948770 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.948748 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:20.955870 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:20.955834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kq4r\" (UniqueName: \"kubernetes.io/projected/3138f33c-618d-477f-a525-768015287d68-kube-api-access-6kq4r\") pod \"metrics-server-55b885979c-7jbf5\" (UID: \"3138f33c-618d-477f-a525-768015287d68\") " pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:21.028377 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.028340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:21.176532 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.176506 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55b885979c-7jbf5"] Jul 31 14:49:21.178541 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:21.178516 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3138f33c_618d_477f_a525_768015287d68.slice/crio-35badd6b9a63d8e070c7af2d78b05981721665b485827af23e78ef92af811b58 WatchSource:0}: Error finding container 35badd6b9a63d8e070c7af2d78b05981721665b485827af23e78ef92af811b58: Status 404 returned error can't find the container with id 35badd6b9a63d8e070c7af2d78b05981721665b485827af23e78ef92af811b58 Jul 31 14:49:21.203924 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.203901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:21.362232 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.362206 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jn8r2" Jul 31 14:49:21.417789 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.417753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" event={"ID":"3138f33c-618d-477f-a525-768015287d68","Type":"ContainerStarted","Data":"35badd6b9a63d8e070c7af2d78b05981721665b485827af23e78ef92af811b58"} Jul 31 14:49:21.424322 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.424289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d"} Jul 31 14:49:21.424458 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.424348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1"} Jul 31 14:49:21.424458 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.424372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b"} Jul 31 14:49:21.424458 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.424395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955"} Jul 31 14:49:21.424458 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:21.424420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382"} Jul 31 14:49:22.434761 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:22.434664 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerStarted","Data":"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45"} Jul 31 14:49:22.515416 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:22.515257 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.035254357 podStartE2EDuration="5.515234153s" totalImagesPullingTime="3.462285328s" totalInitContainerRuntime="17.694468ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:22.514325313 +0000 UTC m=+83.973938695" watchObservedRunningTime="2026-07-31 14:49:22.515234153 +0000 UTC m=+83.974847532" Jul 31 14:49:22.626781 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:22.626699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:23.440787 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.440746 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" event={"ID":"3138f33c-618d-477f-a525-768015287d68","Type":"ContainerStarted","Data":"f492baa03f34a5536ee66721644031bdd03cf9c01ac679ba6d3f3dfdea2b97c2"} Jul 31 14:49:23.880106 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.880056 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" podStartSLOduration=2.625865766 podStartE2EDuration="3.880039085s" totalImagesPullingTime="1.254173319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:23.465625227 +0000 UTC m=+84.925238605" watchObservedRunningTime="2026-07-31 14:49:23.880039085 +0000 UTC m=+85.339652462" Jul 31 14:49:23.880291 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.880174 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-9pbbl"] Jul 31 14:49:23.884436 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.884419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:23.887327 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.887309 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 31 14:49:23.888401 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.888382 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tk4zj\"" Jul 31 14:49:23.888500 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.888408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 31 14:49:23.889119 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.889089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:23.906442 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.906424 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-9pbbl"] Jul 31 14:49:23.966316 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:23.966293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8c72\" (UniqueName: \"kubernetes.io/projected/fbffa3c6-9649-47fe-88c0-efd5cd532622-kube-api-access-b8c72\") pod \"downloads-77c974ffcf-9pbbl\" (UID: \"fbffa3c6-9649-47fe-88c0-efd5cd532622\") " pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:24.032483 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.032456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.066844 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.066821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8c72\" (UniqueName: \"kubernetes.io/projected/fbffa3c6-9649-47fe-88c0-efd5cd532622-kube-api-access-b8c72\") pod \"downloads-77c974ffcf-9pbbl\" (UID: \"fbffa3c6-9649-47fe-88c0-efd5cd532622\") " pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:24.080138 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.080117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8c72\" (UniqueName: \"kubernetes.io/projected/fbffa3c6-9649-47fe-88c0-efd5cd532622-kube-api-access-b8c72\") pod \"downloads-77c974ffcf-9pbbl\" (UID: \"fbffa3c6-9649-47fe-88c0-efd5cd532622\") " pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:24.128623 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.128601 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.193571 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.193520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:24.225176 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.225137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.331357 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.331317 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-9pbbl"] Jul 31 14:49:24.335111 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:24.335086 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbffa3c6_9649_47fe_88c0_efd5cd532622.slice/crio-9a34d3522ddc8c145bbacdaf77df8524a9906a24a6c344a3051a236349837790 WatchSource:0}: Error finding container 9a34d3522ddc8c145bbacdaf77df8524a9906a24a6c344a3051a236349837790: Status 404 returned error can't find the container with id 9a34d3522ddc8c145bbacdaf77df8524a9906a24a6c344a3051a236349837790 Jul 31 14:49:24.341684 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.341661 2579 patch_prober.go:28] interesting pod/image-registry-8458494497-8kjsc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 14:49:24.341769 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.341707 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8458494497-8kjsc" podUID="92aadaef-e017-4512-beb1-def48edb20cb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 14:49:24.363100 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.363078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.444795 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.444735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-9pbbl" event={"ID":"fbffa3c6-9649-47fe-88c0-efd5cd532622","Type":"ContainerStarted","Data":"9a34d3522ddc8c145bbacdaf77df8524a9906a24a6c344a3051a236349837790"} Jul 31 14:49:24.458116 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.458089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.615210 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.615186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.944463 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:24.944420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:25.009135 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:25.009101 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:25.575156 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:25.575111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:25.763197 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:25.763167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:25.979125 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:25.979034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:26.594615 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:26.594586 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:26.724623 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:26.724570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.197743 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.197700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.272432 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.272389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.340383 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.340358 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8458494497-8kjsc" Jul 31 14:49:27.538460 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.538426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.632801 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.632762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.838118 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.838031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.939127 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:27.939093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:29.440652 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:29.440589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:29.573496 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:29.573464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:33.480156 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.480123 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-db9797bfd-rfm29"] Jul 31 14:49:33.485878 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.485850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.490380 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.490355 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 31 14:49:33.490520 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.490400 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bcg2z\"" Jul 31 14:49:33.490520 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.490499 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 31 14:49:33.491182 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.491161 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 31 14:49:33.491899 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.491878 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 31 14:49:33.494477 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.494446 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 31 14:49:33.505398 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.505376 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db9797bfd-rfm29"] Jul 31 14:49:33.650988 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.650950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-oauth-config\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.651127 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.651010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64rj\" (UniqueName: \"kubernetes.io/projected/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-kube-api-access-r64rj\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.651127 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.651085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-service-ca\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.651127 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.651118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-config\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.651262 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.651155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-serving-cert\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.651262 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.651186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-oauth-serving-cert\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.752366 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.752299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-oauth-config\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.752366 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.752357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64rj\" (UniqueName: \"kubernetes.io/projected/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-kube-api-access-r64rj\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.752561 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.752386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-service-ca\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.752561 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.752404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-config\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.752561 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.752432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-serving-cert\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.752561 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.752464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-oauth-serving-cert\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.753368 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.753312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-oauth-serving-cert\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.753716 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.753699 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-service-ca\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.754092 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.754073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-config\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.755527 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.755503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-oauth-config\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.755629 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.755610 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-serving-cert\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.765457 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.765431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64rj\" (UniqueName: \"kubernetes.io/projected/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-kube-api-access-r64rj\") pod \"console-db9797bfd-rfm29\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.799219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.799034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:33.891457 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.891421 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:33.993369 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:33.993319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:35.198245 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:35.198165 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:35.297351 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:35.297318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:35.672120 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:35.672085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:35.778946 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:35.778895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:36.556236 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:36.556193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:36.616109 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:36.616029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.210991 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:38.210883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.292667 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:38.292639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.632759 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:38.632692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.734777 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:38.734745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:39.440804 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:39.440772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:39.538815 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:39.538773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:40.788581 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.788546 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc89d9c4c-4kn5x"] Jul 31 14:49:40.828591 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.828562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc89d9c4c-4kn5x"] Jul 31 14:49:40.828747 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.828678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.839703 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.839678 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 31 14:49:40.907036 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-oauth-serving-cert\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.907163 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-service-ca\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.907163 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-trusted-ca-bundle\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.907163 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-serving-cert\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.907304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-oauth-config\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.907304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt6kq\" (UniqueName: \"kubernetes.io/projected/dc8339b3-18ed-4fcd-882d-691cb2577531-kube-api-access-kt6kq\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:40.907304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:40.907240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-console-config\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008459 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-service-ca\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008596 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-trusted-ca-bundle\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008596 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-serving-cert\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008596 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-oauth-config\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008596 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt6kq\" (UniqueName: \"kubernetes.io/projected/dc8339b3-18ed-4fcd-882d-691cb2577531-kube-api-access-kt6kq\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008596 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-console-config\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.008909 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.008649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-oauth-serving-cert\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.009346 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.009161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-service-ca\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.009832 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.009809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-console-config\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.009915 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.009841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-oauth-serving-cert\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.010284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.010262 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-trusted-ca-bundle\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.011495 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.011474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-oauth-config\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.011591 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.011540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-serving-cert\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.025122 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.025092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt6kq\" (UniqueName: \"kubernetes.io/projected/dc8339b3-18ed-4fcd-882d-691cb2577531-kube-api-access-kt6kq\") pod \"console-6dc89d9c4c-4kn5x\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.028960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.028922 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:41.029061 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.028998 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:49:41.139777 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.139746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:41.141693 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.141658 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db9797bfd-rfm29"] Jul 31 14:49:41.145263 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:41.145239 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e7ec31_78b4_46a2_aba3_8b86fc4f70a0.slice/crio-216a6079a5390477ffbef980619a1046d34ca18f8b8af0dfab41732b9f8e2929 WatchSource:0}: Error finding container 216a6079a5390477ffbef980619a1046d34ca18f8b8af0dfab41732b9f8e2929: Status 404 returned error can't find the container with id 216a6079a5390477ffbef980619a1046d34ca18f8b8af0dfab41732b9f8e2929 Jul 31 14:49:41.175897 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.175874 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:41.249079 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.249040 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:41.293550 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.293442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc89d9c4c-4kn5x"] Jul 31 14:49:41.393046 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:49:41.392986 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8339b3_18ed_4fcd_882d_691cb2577531.slice/crio-7a1356939ba4aa93c965e33b482f7f9800196e842e4d47456a2e1be16d5abe8e WatchSource:0}: Error finding container 7a1356939ba4aa93c965e33b482f7f9800196e842e4d47456a2e1be16d5abe8e: Status 404 returned error can't find the container with id 7a1356939ba4aa93c965e33b482f7f9800196e842e4d47456a2e1be16d5abe8e Jul 31 14:49:41.523537 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.523511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc89d9c4c-4kn5x" event={"ID":"dc8339b3-18ed-4fcd-882d-691cb2577531","Type":"ContainerStarted","Data":"7a1356939ba4aa93c965e33b482f7f9800196e842e4d47456a2e1be16d5abe8e"} Jul 31 14:49:41.524718 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:41.524696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db9797bfd-rfm29" event={"ID":"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0","Type":"ContainerStarted","Data":"216a6079a5390477ffbef980619a1046d34ca18f8b8af0dfab41732b9f8e2929"} Jul 31 14:49:42.363195 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:42.363161 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d8rt9" Jul 31 14:49:42.534208 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:42.533414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-9pbbl" event={"ID":"fbffa3c6-9649-47fe-88c0-efd5cd532622","Type":"ContainerStarted","Data":"7b727f843315c3902d3f2eccbc5adb0972e926062969075862fdb045fe04da74"} Jul 31 14:49:42.536728 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:42.536703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:42.550061 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:42.549964 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-9pbbl" Jul 31 14:49:42.557837 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:42.557223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-9pbbl" podStartSLOduration=2.434247486 podStartE2EDuration="19.557205511s" totalImagesPullingTime="17.122958025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:42.555260116 +0000 UTC m=+104.014873497" watchObservedRunningTime="2026-07-31 14:49:42.557205511 +0000 UTC m=+104.016818888" Jul 31 14:49:44.016803 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:44.016734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:44.128337 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:44.128263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:46.555959 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:46.555887 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db9797bfd-rfm29" event={"ID":"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0","Type":"ContainerStarted","Data":"bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f"} Jul 31 14:49:46.557672 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:46.557640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc89d9c4c-4kn5x" event={"ID":"dc8339b3-18ed-4fcd-882d-691cb2577531","Type":"ContainerStarted","Data":"52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28"} Jul 31 14:49:46.601462 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:46.601409 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-db9797bfd-rfm29" podStartSLOduration=8.806841268 podStartE2EDuration="13.601388501s" totalImagesPullingTime="4.794547233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:46.579293221 +0000 UTC m=+108.038906601" watchObservedRunningTime="2026-07-31 14:49:46.601388501 +0000 UTC m=+108.061001881" Jul 31 14:49:46.602308 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:46.602274 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dc89d9c4c-4kn5x" podStartSLOduration=2.084322084 podStartE2EDuration="6.602264392s" totalImagesPullingTime="4.517942308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:46.600526072 +0000 UTC m=+108.060139447" watchObservedRunningTime="2026-07-31 14:49:46.602264392 +0000 UTC m=+108.061877770" Jul 31 14:49:47.845343 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:47.845305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:47.943388 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:47.943352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:51.140869 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.140838 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:51.141370 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.141184 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:51.145696 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.145674 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:51.582704 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.582676 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:49:51.650273 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.650239 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db9797bfd-rfm29"] Jul 31 14:49:51.769612 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.769577 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:51.871863 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.871785 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:51.967297 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:51.967266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:52.574577 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:52.574539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:53.799518 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:53.799485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:49:54.413751 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:54.413715 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:54.474534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:49:54.474506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:01.033670 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:01.033642 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:50:01.041768 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:01.041742 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55b885979c-7jbf5" Jul 31 14:50:05.405577 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:05.405546 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wm6n_706fdd7b-4f48-4841-9302-a70ccea9d7d8/serve-healthcheck-canary/0.log" Jul 31 14:50:07.026555 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:07.026518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:07.126023 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:07.125984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:07.190542 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:07.190509 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:09.416420 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:09.416386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:09.516683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:09.516658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:16.669598 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:16.669531 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-db9797bfd-rfm29" podUID="56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" containerName="console" containerID="cri-o://bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f" gracePeriod=15 Jul 31 14:50:16.982761 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:16.982408 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:50:17.108470 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108439 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-config\") pod \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " Jul 31 14:50:17.108637 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108519 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r64rj\" (UniqueName: \"kubernetes.io/projected/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-kube-api-access-r64rj\") pod \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " Jul 31 14:50:17.108637 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108541 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-oauth-config\") pod \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " Jul 31 14:50:17.108637 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108566 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-service-ca\") pod \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " Jul 31 14:50:17.108637 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108616 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-oauth-serving-cert\") pod \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " Jul 31 14:50:17.108821 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108644 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-serving-cert\") pod \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\" (UID: \"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0\") " Jul 31 14:50:17.108821 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108798 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-config" (OuterVolumeSpecName: "console-config") pod "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" (UID: "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:17.108927 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108837 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" (UID: "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:17.108927 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108915 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-service-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:17.109051 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.108957 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:17.109107 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.109047 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" (UID: "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:17.110998 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.110964 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-kube-api-access-r64rj" (OuterVolumeSpecName: "kube-api-access-r64rj") pod "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" (UID: "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0"). InnerVolumeSpecName "kube-api-access-r64rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:17.110998 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.110979 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" (UID: "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:17.111190 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.111001 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" (UID: "56e7ec31-78b4-46a2-aba3-8b86fc4f70a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:17.209639 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.209562 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r64rj\" (UniqueName: \"kubernetes.io/projected/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-kube-api-access-r64rj\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:17.209639 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.209591 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-oauth-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:17.209639 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.209603 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-oauth-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:17.209639 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.209616 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0-console-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:17.681616 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.681584 2579 generic.go:356] "Generic (PLEG): container finished" podID="56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" containerID="bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f" exitCode=0 Jul 31 14:50:17.682036 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.681631 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db9797bfd-rfm29" Jul 31 14:50:17.682036 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.681668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db9797bfd-rfm29" event={"ID":"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0","Type":"ContainerDied","Data":"bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f"} Jul 31 14:50:17.682036 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.681714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db9797bfd-rfm29" event={"ID":"56e7ec31-78b4-46a2-aba3-8b86fc4f70a0","Type":"ContainerDied","Data":"216a6079a5390477ffbef980619a1046d34ca18f8b8af0dfab41732b9f8e2929"} Jul 31 14:50:17.682036 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.681738 2579 scope.go:117] "RemoveContainer" containerID="bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f" Jul 31 14:50:17.691026 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.691007 2579 scope.go:117] "RemoveContainer" containerID="bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f" Jul 31 14:50:17.691332 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:17.691310 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f\": container with ID starting with bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f not found: ID does not exist" containerID="bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f" Jul 31 14:50:17.691401 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.691346 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f"} err="failed to get container status \"bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f\": rpc error: code = NotFound desc = could not find container \"bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f\": container with ID starting with bc59f5ac42f137519e777951ed383cd2d6d71a5145ea5f6c6824aca4c55e031f not found: ID does not exist" Jul 31 14:50:17.711904 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.711872 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db9797bfd-rfm29"] Jul 31 14:50:17.714963 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:17.714919 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db9797bfd-rfm29"] Jul 31 14:50:19.042873 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:19.042842 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" path="/var/lib/kubelet/pods/56e7ec31-78b4-46a2-aba3-8b86fc4f70a0/volumes" Jul 31 14:50:28.257755 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:28.257715 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:35.632052 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:35.632011 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:35.849772 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:35.849729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:36.668685 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.668652 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:36.669078 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.668986 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="alertmanager" containerID="cri-o://3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382" gracePeriod=120 Jul 31 14:50:36.669078 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.669037 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-metric" containerID="cri-o://4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d" gracePeriod=120 Jul 31 14:50:36.669194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.669085 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="config-reloader" containerID="cri-o://de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955" gracePeriod=120 Jul 31 14:50:36.669194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.669081 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy" containerID="cri-o://f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1" gracePeriod=120 Jul 31 14:50:36.669194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.669041 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-web" containerID="cri-o://85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b" gracePeriod=120 Jul 31 14:50:36.669194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:36.669136 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="prom-label-proxy" containerID="cri-o://6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45" gracePeriod=120 Jul 31 14:50:37.766863 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.766836 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45" exitCode=0 Jul 31 14:50:37.766863 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.766860 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1" exitCode=0 Jul 31 14:50:37.766863 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.766866 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955" exitCode=0 Jul 31 14:50:37.767294 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.766872 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382" exitCode=0 Jul 31 14:50:37.767294 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.766917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45"} Jul 31 14:50:37.767294 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.767021 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1"} Jul 31 14:50:37.767294 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.767066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955"} Jul 31 14:50:37.767294 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.767107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382"} Jul 31 14:50:37.911270 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:37.911245 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.078104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078067 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-cluster-tls-config\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078111 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078143 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-tls-assets\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078173 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-trusted-ca-bundle\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078210 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-volume\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078236 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw54d\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-kube-api-access-bw54d\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078284 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078269 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-main-tls\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078575 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078304 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-metrics-client-ca\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078575 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078334 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078575 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078367 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-web-config\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078575 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078400 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-web\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078575 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078470 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-out\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078575 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078523 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-main-db\") pod \"9d9d3dba-9d68-4023-9e27-9f05941bec01\" (UID: \"9d9d3dba-9d68-4023-9e27-9f05941bec01\") " Jul 31 14:50:38.078846 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078599 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:38.078846 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078671 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:38.078964 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.078805 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-metrics-client-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.079034 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.079009 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.079479 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.079411 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:50:38.081304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.081268 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-volume" (OuterVolumeSpecName: "config-volume") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.081581 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.081502 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:38.081581 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.081532 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.081742 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.081602 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-out" (OuterVolumeSpecName: "config-out") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:50:38.082257 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.082228 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.082350 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.082286 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-kube-api-access-bw54d" (OuterVolumeSpecName: "kube-api-access-bw54d") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "kube-api-access-bw54d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:38.082423 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.082370 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.082959 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.082918 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.085831 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.085765 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.093166 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.093146 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-web-config" (OuterVolumeSpecName: "web-config") pod "9d9d3dba-9d68-4023-9e27-9f05941bec01" (UID: "9d9d3dba-9d68-4023-9e27-9f05941bec01"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:38.180218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180194 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-alertmanager-main-db\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180216 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-cluster-tls-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180226 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180235 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-tls-assets\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180244 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-volume\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180260 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw54d\" (UniqueName: \"kubernetes.io/projected/9d9d3dba-9d68-4023-9e27-9f05941bec01-kube-api-access-bw54d\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180268 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-main-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180277 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180287 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-web-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180297 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d9d3dba-9d68-4023-9e27-9f05941bec01-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.180341 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.180306 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d9d3dba-9d68-4023-9e27-9f05941bec01-config-out\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:50:38.776450 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776419 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d" exitCode=0 Jul 31 14:50:38.776450 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776444 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerID="85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b" exitCode=0 Jul 31 14:50:38.776861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d"} Jul 31 14:50:38.776861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776493 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.776861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776538 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b"} Jul 31 14:50:38.776861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9d9d3dba-9d68-4023-9e27-9f05941bec01","Type":"ContainerDied","Data":"e29e7370d95325fcd75166d8c73c290b5df7050e14d1378fd0e8ac9922aaa231"} Jul 31 14:50:38.776861 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.776594 2579 scope.go:117] "RemoveContainer" containerID="6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45" Jul 31 14:50:38.784974 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.784745 2579 scope.go:117] "RemoveContainer" containerID="4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d" Jul 31 14:50:38.791743 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.791729 2579 scope.go:117] "RemoveContainer" containerID="f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1" Jul 31 14:50:38.803149 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.803126 2579 scope.go:117] "RemoveContainer" containerID="85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b" Jul 31 14:50:38.809741 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.809720 2579 scope.go:117] "RemoveContainer" containerID="de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955" Jul 31 14:50:38.816853 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.816833 2579 scope.go:117] "RemoveContainer" containerID="3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382" Jul 31 14:50:38.823494 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.823478 2579 scope.go:117] "RemoveContainer" containerID="061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5" Jul 31 14:50:38.829453 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.829433 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:38.830660 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.830645 2579 scope.go:117] "RemoveContainer" containerID="6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45" Jul 31 14:50:38.830920 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.830900 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45\": container with ID starting with 6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45 not found: ID does not exist" containerID="6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45" Jul 31 14:50:38.830990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.830928 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45"} err="failed to get container status \"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45\": rpc error: code = NotFound desc = could not find container \"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45\": container with ID starting with 6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45 not found: ID does not exist" Jul 31 14:50:38.830990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.830962 2579 scope.go:117] "RemoveContainer" containerID="4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d" Jul 31 14:50:38.831186 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.831170 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d\": container with ID starting with 4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d not found: ID does not exist" containerID="4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d" Jul 31 14:50:38.831219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831190 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d"} err="failed to get container status \"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d\": rpc error: code = NotFound desc = could not find container \"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d\": container with ID starting with 4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d not found: ID does not exist" Jul 31 14:50:38.831219 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831201 2579 scope.go:117] "RemoveContainer" containerID="f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1" Jul 31 14:50:38.831413 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.831396 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1\": container with ID starting with f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1 not found: ID does not exist" containerID="f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1" Jul 31 14:50:38.831462 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831417 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1"} err="failed to get container status \"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1\": rpc error: code = NotFound desc = could not find container \"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1\": container with ID starting with f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1 not found: ID does not exist" Jul 31 14:50:38.831462 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831432 2579 scope.go:117] "RemoveContainer" containerID="85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b" Jul 31 14:50:38.831659 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.831642 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b\": container with ID starting with 85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b not found: ID does not exist" containerID="85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b" Jul 31 14:50:38.831702 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831664 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b"} err="failed to get container status \"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b\": rpc error: code = NotFound desc = could not find container \"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b\": container with ID starting with 85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b not found: ID does not exist" Jul 31 14:50:38.831702 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831678 2579 scope.go:117] "RemoveContainer" containerID="de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955" Jul 31 14:50:38.831906 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.831891 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955\": container with ID starting with de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955 not found: ID does not exist" containerID="de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955" Jul 31 14:50:38.831967 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831909 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955"} err="failed to get container status \"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955\": rpc error: code = NotFound desc = could not find container \"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955\": container with ID starting with de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955 not found: ID does not exist" Jul 31 14:50:38.831967 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.831928 2579 scope.go:117] "RemoveContainer" containerID="3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382" Jul 31 14:50:38.832176 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.832161 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382\": container with ID starting with 3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382 not found: ID does not exist" containerID="3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382" Jul 31 14:50:38.832225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832180 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382"} err="failed to get container status \"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382\": rpc error: code = NotFound desc = could not find container \"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382\": container with ID starting with 3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382 not found: ID does not exist" Jul 31 14:50:38.832225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832193 2579 scope.go:117] "RemoveContainer" containerID="061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5" Jul 31 14:50:38.832420 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:50:38.832405 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5\": container with ID starting with 061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5 not found: ID does not exist" containerID="061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5" Jul 31 14:50:38.832457 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832424 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5"} err="failed to get container status \"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5\": rpc error: code = NotFound desc = could not find container \"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5\": container with ID starting with 061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5 not found: ID does not exist" Jul 31 14:50:38.832457 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832436 2579 scope.go:117] "RemoveContainer" containerID="6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45" Jul 31 14:50:38.832647 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832629 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45"} err="failed to get container status \"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45\": rpc error: code = NotFound desc = could not find container \"6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45\": container with ID starting with 6c2ff86c290dc05dfd4a53d316e1939de2df3b1cd71a7ef408b0b39aad674f45 not found: ID does not exist" Jul 31 14:50:38.832716 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832660 2579 scope.go:117] "RemoveContainer" containerID="4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d" Jul 31 14:50:38.832872 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832856 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d"} err="failed to get container status \"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d\": rpc error: code = NotFound desc = could not find container \"4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d\": container with ID starting with 4c4deeb79bbf0a12a2caf7f01ce007e4c95385219f7881d4b9540cdf8531dd4d not found: ID does not exist" Jul 31 14:50:38.832960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.832875 2579 scope.go:117] "RemoveContainer" containerID="f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1" Jul 31 14:50:38.833125 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833106 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1"} err="failed to get container status \"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1\": rpc error: code = NotFound desc = could not find container \"f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1\": container with ID starting with f279c0b2ffae912e4bdc44d0a5b8bce58226b816843797745da7b3c533da18c1 not found: ID does not exist" Jul 31 14:50:38.833192 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833126 2579 scope.go:117] "RemoveContainer" containerID="85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b" Jul 31 14:50:38.833329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833303 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b"} err="failed to get container status \"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b\": rpc error: code = NotFound desc = could not find container \"85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b\": container with ID starting with 85581bf132bdbbad3d4031c99b19b7e379874fd70c50facb8b2ac00faf23790b not found: ID does not exist" Jul 31 14:50:38.833329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833327 2579 scope.go:117] "RemoveContainer" containerID="de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955" Jul 31 14:50:38.833546 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833530 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955"} err="failed to get container status \"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955\": rpc error: code = NotFound desc = could not find container \"de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955\": container with ID starting with de3c42344265e319e940bff8b67445e48cd783bb0054f0043bcebb1385e79955 not found: ID does not exist" Jul 31 14:50:38.833594 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833546 2579 scope.go:117] "RemoveContainer" containerID="3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382" Jul 31 14:50:38.833726 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833709 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382"} err="failed to get container status \"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382\": rpc error: code = NotFound desc = could not find container \"3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382\": container with ID starting with 3877241fac7c4b3b5d05d36d240272364e1282332371c9af40c67062bea51382 not found: ID does not exist" Jul 31 14:50:38.833726 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833725 2579 scope.go:117] "RemoveContainer" containerID="061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5" Jul 31 14:50:38.833969 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.833953 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5"} err="failed to get container status \"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5\": rpc error: code = NotFound desc = could not find container \"061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5\": container with ID starting with 061cfc9b660cdc11356e12e96f2fecba7f83fac815954b3d9008054fe95ebce5 not found: ID does not exist" Jul 31 14:50:38.845990 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.845972 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:38.894115 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894094 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:38.894399 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894387 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy" Jul 31 14:50:38.894437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894402 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy" Jul 31 14:50:38.894437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894411 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-metric" Jul 31 14:50:38.894437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894417 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-metric" Jul 31 14:50:38.894437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894430 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="init-config-reloader" Jul 31 14:50:38.894437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894435 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="init-config-reloader" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894441 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-web" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894450 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-web" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894464 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="alertmanager" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894469 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="alertmanager" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894476 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="config-reloader" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894481 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="config-reloader" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894485 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" containerName="console" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894490 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" containerName="console" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894498 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="prom-label-proxy" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894503 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="prom-label-proxy" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894561 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-metric" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894571 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy-web" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894576 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="prom-label-proxy" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894581 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e7ec31-78b4-46a2-aba3-8b86fc4f70a0" containerName="console" Jul 31 14:50:38.894586 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894586 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="alertmanager" Jul 31 14:50:38.895047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894592 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="kube-rbac-proxy" Jul 31 14:50:38.895047 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.894598 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" containerName="config-reloader" Jul 31 14:50:38.900011 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.899993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.905927 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.905759 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 14:50:38.906323 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.906299 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 14:50:38.906446 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.906428 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 14:50:38.906654 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.906639 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-btx28\"" Jul 31 14:50:38.906709 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.906653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 14:50:38.906773 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.906753 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 14:50:38.907537 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.907517 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 14:50:38.907620 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.907548 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 14:50:38.907859 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.907843 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 14:50:38.919998 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.919984 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 14:50:38.928067 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.928047 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:38.985153 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1769423c-b008-4900-bfa6-3df31083be09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985153 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985125 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-web-config\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985302 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985302 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985302 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1769423c-b008-4900-bfa6-3df31083be09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985302 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-config-volume\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985302 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985302 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1769423c-b008-4900-bfa6-3df31083be09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b476q\" (UniqueName: \"kubernetes.io/projected/1769423c-b008-4900-bfa6-3df31083be09-kube-api-access-b476q\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1769423c-b008-4900-bfa6-3df31083be09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:38.985569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:38.985467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1769423c-b008-4900-bfa6-3df31083be09-config-out\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.042229 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.042195 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9d3dba-9d68-4023-9e27-9f05941bec01" path="/var/lib/kubelet/pods/9d9d3dba-9d68-4023-9e27-9f05941bec01/volumes" Jul 31 14:50:39.085766 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.085833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b476q\" (UniqueName: \"kubernetes.io/projected/1769423c-b008-4900-bfa6-3df31083be09-kube-api-access-b476q\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.085833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1769423c-b008-4900-bfa6-3df31083be09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.085917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1769423c-b008-4900-bfa6-3df31083be09-config-out\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.085917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1769423c-b008-4900-bfa6-3df31083be09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.085917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-web-config\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.085993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.086038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1769423c-b008-4900-bfa6-3df31083be09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086089 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.086070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-config-volume\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086280 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.086102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086280 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.086145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086280 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.086182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1769423c-b008-4900-bfa6-3df31083be09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.086886 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.086648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1769423c-b008-4900-bfa6-3df31083be09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.087295 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.087252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1769423c-b008-4900-bfa6-3df31083be09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.087560 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.087543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1769423c-b008-4900-bfa6-3df31083be09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089025 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.088931 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089232 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.089204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1769423c-b008-4900-bfa6-3df31083be09-config-out\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.089440 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-config-volume\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.089605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.089708 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.089724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1769423c-b008-4900-bfa6-3df31083be09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.089833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.089795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.090712 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.090678 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.091211 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.091192 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1769423c-b008-4900-bfa6-3df31083be09-web-config\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.095248 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.095230 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b476q\" (UniqueName: \"kubernetes.io/projected/1769423c-b008-4900-bfa6-3df31083be09-kube-api-access-b476q\") pod \"alertmanager-main-0\" (UID: \"1769423c-b008-4900-bfa6-3df31083be09\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.209044 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.209022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:39.356009 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.355903 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:39.358066 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:50:39.358042 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1769423c_b008_4900_bfa6_3df31083be09.slice/crio-a5f674144abae8e4b4893925f984956abff6f4390ced3a19025baeed7b1c1e9b WatchSource:0}: Error finding container a5f674144abae8e4b4893925f984956abff6f4390ced3a19025baeed7b1c1e9b: Status 404 returned error can't find the container with id a5f674144abae8e4b4893925f984956abff6f4390ced3a19025baeed7b1c1e9b Jul 31 14:50:39.783132 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.783100 2579 generic.go:356] "Generic (PLEG): container finished" podID="1769423c-b008-4900-bfa6-3df31083be09" containerID="9870b670061f48d95aa8c6d948ca8af98b84b02496fecd6b7dfe32fa21857163" exitCode=0 Jul 31 14:50:39.783543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.783192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerDied","Data":"9870b670061f48d95aa8c6d948ca8af98b84b02496fecd6b7dfe32fa21857163"} Jul 31 14:50:39.783543 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:39.783267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"a5f674144abae8e4b4893925f984956abff6f4390ced3a19025baeed7b1c1e9b"} Jul 31 14:50:40.754574 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.754539 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4"] Jul 31 14:50:40.757627 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.757600 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.760686 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.760662 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 31 14:50:40.760820 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.760727 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 31 14:50:40.760820 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.760773 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 31 14:50:40.762239 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.762221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 31 14:50:40.762504 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.762489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xxq8s\"" Jul 31 14:50:40.768503 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.768483 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 31 14:50:40.768728 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.768709 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 31 14:50:40.779743 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.779716 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4"] Jul 31 14:50:40.792927 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.792892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"3ba9b0ead2c9a12ffb0d88bcd5098665a6658ba575fb16dc7687d3a5eef3a6f1"} Jul 31 14:50:40.793349 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.792983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"dbbc94541c5af650da243b96c425ec1adbe1ca0b150396b3d75ebe0859fed5c3"} Jul 31 14:50:40.793349 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.793028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"81c1e6c89834578b3fa5814d39cef6034c8730aa3c9085a4b4162f56e25bda3d"} Jul 31 14:50:40.793349 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.793067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"118e7feafd03924d0319a36bd6a2a5fbe57eccf0e4a213c8b6949dd0a15bf092"} Jul 31 14:50:40.793349 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.793106 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"004eddaa99e23a27b1d845d0152d40887a26d4c4628f094968c8b84b05d56f36"} Jul 31 14:50:40.793349 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.793143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1769423c-b008-4900-bfa6-3df31083be09","Type":"ContainerStarted","Data":"e807a6f798f42c8b388d2ce8eb78138cd3b23408c91cdaed842ed74e84a50a22"} Jul 31 14:50:40.800985 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.800959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801087 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-serving-certs-ca-bundle\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801272 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-metrics-client-ca\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801348 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801408 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-telemeter-client-tls\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801495 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-secret-telemeter-client\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801754 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-federate-client-tls\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.801754 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.801628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnxjz\" (UniqueName: \"kubernetes.io/projected/9f642655-2d43-4d64-b3e7-aa215996eb57-kube-api-access-wnxjz\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.832386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.832321 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.814539518 podStartE2EDuration="2.832307619s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.768101ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:40.831022049 +0000 UTC m=+162.290635438" watchObservedRunningTime="2026-07-31 14:50:40.832307619 +0000 UTC m=+162.291920997" Jul 31 14:50:40.902822 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.902792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-metrics-client-ca\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903052 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.902828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903052 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.902851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-telemeter-client-tls\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903052 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.902884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-secret-telemeter-client\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903052 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.902912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-federate-client-tls\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903052 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.902965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxjz\" (UniqueName: \"kubernetes.io/projected/9f642655-2d43-4d64-b3e7-aa215996eb57-kube-api-access-wnxjz\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903316 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.903126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903316 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.903195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-serving-certs-ca-bundle\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903786 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.903762 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-metrics-client-ca\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.903965 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.903855 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-serving-certs-ca-bundle\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.904350 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.904281 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f642655-2d43-4d64-b3e7-aa215996eb57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.905988 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.905960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.906151 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.906134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-telemeter-client-tls\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.906225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.906130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-federate-client-tls\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.906225 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.906130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9f642655-2d43-4d64-b3e7-aa215996eb57-secret-telemeter-client\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:40.912505 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:40.912484 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnxjz\" (UniqueName: \"kubernetes.io/projected/9f642655-2d43-4d64-b3e7-aa215996eb57-kube-api-access-wnxjz\") pod \"telemeter-client-5ccbffddf5-z4cx4\" (UID: \"9f642655-2d43-4d64-b3e7-aa215996eb57\") " pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:41.067960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:41.067912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" Jul 31 14:50:41.222948 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:41.222911 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4"] Jul 31 14:50:41.225264 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:50:41.225235 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f642655_2d43_4d64_b3e7_aa215996eb57.slice/crio-82efb3dc494e527814db563060f6d969aaf58b9846de6b8976df42cafd61425b WatchSource:0}: Error finding container 82efb3dc494e527814db563060f6d969aaf58b9846de6b8976df42cafd61425b: Status 404 returned error can't find the container with id 82efb3dc494e527814db563060f6d969aaf58b9846de6b8976df42cafd61425b Jul 31 14:50:41.802835 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:41.802795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" event={"ID":"9f642655-2d43-4d64-b3e7-aa215996eb57","Type":"ContainerStarted","Data":"82efb3dc494e527814db563060f6d969aaf58b9846de6b8976df42cafd61425b"} Jul 31 14:50:43.813734 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:43.813699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" event={"ID":"9f642655-2d43-4d64-b3e7-aa215996eb57","Type":"ContainerStarted","Data":"44f0e00e4ff83bb78d9f973c49aab497197cb9977284a4c505a35bdc0e6e4505"} Jul 31 14:50:43.814096 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:43.813765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" event={"ID":"9f642655-2d43-4d64-b3e7-aa215996eb57","Type":"ContainerStarted","Data":"76c53d5a0c721be3f24ef065082d32a318b10a3c832c13e3aeed118aa1303d8a"} Jul 31 14:50:43.814096 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:43.813793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" event={"ID":"9f642655-2d43-4d64-b3e7-aa215996eb57","Type":"ContainerStarted","Data":"e7836b9d03a209af0f672cfca4147a213612b076bf2b7dbe8c27275904a62d21"} Jul 31 14:50:43.848443 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:43.848397 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5ccbffddf5-z4cx4" podStartSLOduration=1.621362287 podStartE2EDuration="3.848381974s" totalImagesPullingTime="2.227019687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:43.847308029 +0000 UTC m=+165.306921406" watchObservedRunningTime="2026-07-31 14:50:43.848381974 +0000 UTC m=+165.307995352" Jul 31 14:50:43.978514 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:43.978490 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f4c49b64-rhrqd"] Jul 31 14:50:43.980830 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:43.980815 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.002040 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.002015 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f4c49b64-rhrqd"] Jul 31 14:50:44.027760 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-service-ca\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.027850 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-console-config\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.027850 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-oauth-serving-cert\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.027850 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-trusted-ca-bundle\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.027966 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2cfk\" (UniqueName: \"kubernetes.io/projected/12aa266e-57c1-4315-97fe-1334718cb8f9-kube-api-access-c2cfk\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.027966 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-oauth-config\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.028030 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.027980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-serving-cert\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.034777 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.034756 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:44.128293 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-console-config\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128293 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-oauth-serving-cert\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128442 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-trusted-ca-bundle\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128442 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2cfk\" (UniqueName: \"kubernetes.io/projected/12aa266e-57c1-4315-97fe-1334718cb8f9-kube-api-access-c2cfk\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128442 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-oauth-config\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128442 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-serving-cert\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128634 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-service-ca\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.128999 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.128980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-oauth-serving-cert\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.129144 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.129117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-console-config\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.129259 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.129191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-service-ca\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.129411 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.129394 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-trusted-ca-bundle\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.130985 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.130966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-oauth-config\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.131109 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.131090 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-serving-cert\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.142741 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.142718 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2cfk\" (UniqueName: \"kubernetes.io/projected/12aa266e-57c1-4315-97fe-1334718cb8f9-kube-api-access-c2cfk\") pod \"console-56f4c49b64-rhrqd\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.145623 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.145604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:44.288988 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.288962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:44.438253 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.438183 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f4c49b64-rhrqd"] Jul 31 14:50:44.441476 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:50:44.441452 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12aa266e_57c1_4315_97fe_1334718cb8f9.slice/crio-96bf3fac1567007d11f7aa8a7d66f1b4c54e1a988822fbfececbecc6de37ac1f WatchSource:0}: Error finding container 96bf3fac1567007d11f7aa8a7d66f1b4c54e1a988822fbfececbecc6de37ac1f: Status 404 returned error can't find the container with id 96bf3fac1567007d11f7aa8a7d66f1b4c54e1a988822fbfececbecc6de37ac1f Jul 31 14:50:44.819629 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.819596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f4c49b64-rhrqd" event={"ID":"12aa266e-57c1-4315-97fe-1334718cb8f9","Type":"ContainerStarted","Data":"466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71"} Jul 31 14:50:44.820046 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.819646 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f4c49b64-rhrqd" event={"ID":"12aa266e-57c1-4315-97fe-1334718cb8f9","Type":"ContainerStarted","Data":"96bf3fac1567007d11f7aa8a7d66f1b4c54e1a988822fbfececbecc6de37ac1f"} Jul 31 14:50:44.847298 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:44.847240 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f4c49b64-rhrqd" podStartSLOduration=1.847222903 podStartE2EDuration="1.847222903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:44.846846146 +0000 UTC m=+166.306459525" watchObservedRunningTime="2026-07-31 14:50:44.847222903 +0000 UTC m=+166.306836281" Jul 31 14:50:54.289432 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:54.289336 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:54.289432 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:54.289400 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:54.294100 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:54.294079 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:54.866805 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:54.866781 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:50:54.928561 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:54.928536 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc89d9c4c-4kn5x"] Jul 31 14:50:55.044206 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:55.044175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:55.143486 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:55.143409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:55.207486 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:50:55.207463 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:19.947908 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:19.947835 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dc89d9c4c-4kn5x" podUID="dc8339b3-18ed-4fcd-882d-691cb2577531" containerName="console" containerID="cri-o://52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28" gracePeriod=15 Jul 31 14:51:20.189425 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.189404 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:51:20.318705 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318680 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt6kq\" (UniqueName: \"kubernetes.io/projected/dc8339b3-18ed-4fcd-882d-691cb2577531-kube-api-access-kt6kq\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.318834 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318722 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-oauth-config\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.318834 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318770 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-serving-cert\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.318834 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318811 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-trusted-ca-bundle\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.319002 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318861 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-console-config\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.319002 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-oauth-serving-cert\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.319002 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.318909 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-service-ca\") pod \"dc8339b3-18ed-4fcd-882d-691cb2577531\" (UID: \"dc8339b3-18ed-4fcd-882d-691cb2577531\") " Jul 31 14:51:20.319319 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.319293 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-console-config" (OuterVolumeSpecName: "console-config") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:51:20.319414 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.319341 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:51:20.319458 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.319418 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:51:20.319693 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.319670 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:51:20.321037 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.321004 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8339b3-18ed-4fcd-882d-691cb2577531-kube-api-access-kt6kq" (OuterVolumeSpecName: "kube-api-access-kt6kq") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "kube-api-access-kt6kq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:51:20.321500 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.321478 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:20.321588 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.321504 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc8339b3-18ed-4fcd-882d-691cb2577531" (UID: "dc8339b3-18ed-4fcd-882d-691cb2577531"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:20.420289 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420262 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-console-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.420289 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420285 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-oauth-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.420437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420298 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-service-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.420437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420310 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt6kq\" (UniqueName: \"kubernetes.io/projected/dc8339b3-18ed-4fcd-882d-691cb2577531-kube-api-access-kt6kq\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.420437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420323 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-oauth-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.420437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420334 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8339b3-18ed-4fcd-882d-691cb2577531-console-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.420437 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.420345 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8339b3-18ed-4fcd-882d-691cb2577531-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:51:20.976743 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.976700 2579 generic.go:356] "Generic (PLEG): container finished" podID="dc8339b3-18ed-4fcd-882d-691cb2577531" containerID="52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28" exitCode=0 Jul 31 14:51:20.976743 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.976739 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc89d9c4c-4kn5x" Jul 31 14:51:20.977241 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.976791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc89d9c4c-4kn5x" event={"ID":"dc8339b3-18ed-4fcd-882d-691cb2577531","Type":"ContainerDied","Data":"52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28"} Jul 31 14:51:20.977241 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.976836 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc89d9c4c-4kn5x" event={"ID":"dc8339b3-18ed-4fcd-882d-691cb2577531","Type":"ContainerDied","Data":"7a1356939ba4aa93c965e33b482f7f9800196e842e4d47456a2e1be16d5abe8e"} Jul 31 14:51:20.977241 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.976857 2579 scope.go:117] "RemoveContainer" containerID="52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28" Jul 31 14:51:20.985242 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.985225 2579 scope.go:117] "RemoveContainer" containerID="52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28" Jul 31 14:51:20.985480 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:51:20.985463 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28\": container with ID starting with 52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28 not found: ID does not exist" containerID="52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28" Jul 31 14:51:20.985522 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.985488 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28"} err="failed to get container status \"52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28\": rpc error: code = NotFound desc = could not find container \"52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28\": container with ID starting with 52e9696e43743f560f997bb44ebd7ae059ca72a627c78a6c2324264feec20e28 not found: ID does not exist" Jul 31 14:51:20.997761 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:20.997735 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc89d9c4c-4kn5x"] Jul 31 14:51:21.001982 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:21.001964 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc89d9c4c-4kn5x"] Jul 31 14:51:21.042301 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:21.042276 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc8339b3-18ed-4fcd-882d-691cb2577531" path="/var/lib/kubelet/pods/dc8339b3-18ed-4fcd-882d-691cb2577531/volumes" Jul 31 14:51:29.792514 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:29.792466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:33.087026 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:33.086990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:35.615268 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:35.615230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:35.683212 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:35.683184 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:50.905766 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:50.905726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:50.964612 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:50.964585 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:52.561722 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.561692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d46c89b7c-wwds8"] Jul 31 14:51:52.562131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.562004 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc8339b3-18ed-4fcd-882d-691cb2577531" containerName="console" Jul 31 14:51:52.562131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.562016 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc8339b3-18ed-4fcd-882d-691cb2577531" containerName="console" Jul 31 14:51:52.562131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.562088 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc8339b3-18ed-4fcd-882d-691cb2577531" containerName="console" Jul 31 14:51:52.564552 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.564534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.580414 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.580390 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d46c89b7c-wwds8"] Jul 31 14:51:52.639763 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.639735 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:52.650773 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-serving-cert\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.650860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-oauth-serving-cert\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.650860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-service-ca\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.650860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-config\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.650860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsfgq\" (UniqueName: \"kubernetes.io/projected/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-kube-api-access-gsfgq\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.651002 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-oauth-config\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.651002 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.650990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-trusted-ca-bundle\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.706263 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.706234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:52.751386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-trusted-ca-bundle\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.751473 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-serving-cert\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.751555 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-oauth-serving-cert\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.751555 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-service-ca\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.751555 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-config\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.751693 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsfgq\" (UniqueName: \"kubernetes.io/projected/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-kube-api-access-gsfgq\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.751693 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.751609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-oauth-config\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.752312 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.752292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-service-ca\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.752312 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.752332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-config\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.752312 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.752339 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-oauth-serving-cert\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.752663 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.752638 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-trusted-ca-bundle\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.754088 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.754066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-serving-cert\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.754182 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.754088 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-oauth-config\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.760467 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.760446 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsfgq\" (UniqueName: \"kubernetes.io/projected/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-kube-api-access-gsfgq\") pod \"console-6d46c89b7c-wwds8\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:52.873633 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:52.873582 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:51:53.006315 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:53.006285 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d46c89b7c-wwds8"] Jul 31 14:51:53.013522 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:51:53.013497 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a2c6e2_24d1_493a_8e4b_be645c38dbaa.slice/crio-ea5ce718a776e91d294cc9a32bb85c8564afbc2f800bf740e954e61be8035b2d WatchSource:0}: Error finding container ea5ce718a776e91d294cc9a32bb85c8564afbc2f800bf740e954e61be8035b2d: Status 404 returned error can't find the container with id ea5ce718a776e91d294cc9a32bb85c8564afbc2f800bf740e954e61be8035b2d Jul 31 14:51:53.111361 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:53.111321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46c89b7c-wwds8" event={"ID":"85a2c6e2-24d1-493a-8e4b-be645c38dbaa","Type":"ContainerStarted","Data":"fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d"} Jul 31 14:51:53.111558 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:53.111401 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46c89b7c-wwds8" event={"ID":"85a2c6e2-24d1-493a-8e4b-be645c38dbaa","Type":"ContainerStarted","Data":"ea5ce718a776e91d294cc9a32bb85c8564afbc2f800bf740e954e61be8035b2d"} Jul 31 14:51:53.132127 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:51:53.132045 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d46c89b7c-wwds8" podStartSLOduration=1.132029523 podStartE2EDuration="1.132029523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:51:53.130697521 +0000 UTC m=+234.590310899" watchObservedRunningTime="2026-07-31 14:51:53.132029523 +0000 UTC m=+234.591642903" Jul 31 14:52:02.802538 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:02.802503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:02.874554 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:02.874526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:52:02.874695 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:02.874586 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:52:02.880060 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:02.880037 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:52:02.903501 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:02.903465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:03.153427 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:03.153366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:52:03.202426 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:03.202401 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f4c49b64-rhrqd"] Jul 31 14:52:03.307491 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:03.307464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:03.390820 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:03.390789 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:03.448435 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:03.448351 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:04.979386 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:04.979347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:09.421446 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:09.421406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:09.520573 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:09.520540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:09.593327 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:09.593272 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:28.221679 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.221644 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56f4c49b64-rhrqd" podUID="12aa266e-57c1-4315-97fe-1334718cb8f9" containerName="console" containerID="cri-o://466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71" gracePeriod=15 Jul 31 14:52:28.467287 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.467265 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:52:28.631558 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631534 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-oauth-serving-cert\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.631683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631570 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-serving-cert\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.631683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631595 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-trusted-ca-bundle\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.631683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631617 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-oauth-config\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.631828 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631754 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-service-ca\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.631828 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631800 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2cfk\" (UniqueName: \"kubernetes.io/projected/12aa266e-57c1-4315-97fe-1334718cb8f9-kube-api-access-c2cfk\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.631962 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.631887 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-console-config\") pod \"12aa266e-57c1-4315-97fe-1334718cb8f9\" (UID: \"12aa266e-57c1-4315-97fe-1334718cb8f9\") " Jul 31 14:52:28.632090 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.632066 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:28.632090 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.632075 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:28.632201 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.632159 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:28.632201 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.632176 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-oauth-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:28.632201 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.632194 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:28.632513 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.632447 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-console-config" (OuterVolumeSpecName: "console-config") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:28.634042 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.634013 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:52:28.634138 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.634041 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:52:28.634138 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.634073 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12aa266e-57c1-4315-97fe-1334718cb8f9-kube-api-access-c2cfk" (OuterVolumeSpecName: "kube-api-access-c2cfk") pod "12aa266e-57c1-4315-97fe-1334718cb8f9" (UID: "12aa266e-57c1-4315-97fe-1334718cb8f9"). InnerVolumeSpecName "kube-api-access-c2cfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:52:28.733218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.733193 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:28.733218 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.733216 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12aa266e-57c1-4315-97fe-1334718cb8f9-console-oauth-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:28.733365 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.733226 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-service-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:28.733365 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.733234 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2cfk\" (UniqueName: \"kubernetes.io/projected/12aa266e-57c1-4315-97fe-1334718cb8f9-kube-api-access-c2cfk\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:28.733365 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:28.733243 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12aa266e-57c1-4315-97fe-1334718cb8f9-console-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:52:29.249421 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.249389 2579 generic.go:356] "Generic (PLEG): container finished" podID="12aa266e-57c1-4315-97fe-1334718cb8f9" containerID="466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71" exitCode=0 Jul 31 14:52:29.249773 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.249423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f4c49b64-rhrqd" event={"ID":"12aa266e-57c1-4315-97fe-1334718cb8f9","Type":"ContainerDied","Data":"466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71"} Jul 31 14:52:29.249773 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.249456 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f4c49b64-rhrqd" Jul 31 14:52:29.249773 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.249511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f4c49b64-rhrqd" event={"ID":"12aa266e-57c1-4315-97fe-1334718cb8f9","Type":"ContainerDied","Data":"96bf3fac1567007d11f7aa8a7d66f1b4c54e1a988822fbfececbecc6de37ac1f"} Jul 31 14:52:29.249773 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.249540 2579 scope.go:117] "RemoveContainer" containerID="466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71" Jul 31 14:52:29.257700 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.257680 2579 scope.go:117] "RemoveContainer" containerID="466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71" Jul 31 14:52:29.258016 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:52:29.257993 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71\": container with ID starting with 466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71 not found: ID does not exist" containerID="466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71" Jul 31 14:52:29.258087 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.258030 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71"} err="failed to get container status \"466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71\": rpc error: code = NotFound desc = could not find container \"466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71\": container with ID starting with 466b89d994d4046e0eb4d43e75a2c331b79ff5e5e216d375c6d61519862abd71 not found: ID does not exist" Jul 31 14:52:29.266131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.266110 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f4c49b64-rhrqd"] Jul 31 14:52:29.272297 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:29.272280 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f4c49b64-rhrqd"] Jul 31 14:52:31.042556 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:31.042514 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12aa266e-57c1-4315-97fe-1334718cb8f9" path="/var/lib/kubelet/pods/12aa266e-57c1-4315-97fe-1334718cb8f9/volumes" Jul 31 14:52:58.914420 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:58.914395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:52:58.918298 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:58.918273 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 14:52:58.918519 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:52:58.918505 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:54:06.499949 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:06.499855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:07.956469 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:07.956436 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:07.994306 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:07.994272 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4"] Jul 31 14:54:08.000273 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.000236 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aa266e-57c1-4315-97fe-1334718cb8f9" containerName="console" Jul 31 14:54:08.000273 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.000268 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aa266e-57c1-4315-97fe-1334718cb8f9" containerName="console" Jul 31 14:54:08.000421 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.000382 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="12aa266e-57c1-4315-97fe-1334718cb8f9" containerName="console" Jul 31 14:54:08.003352 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.003337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.007356 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.007336 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 31 14:54:08.007356 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.007349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zdcgf\"" Jul 31 14:54:08.007529 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.007351 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 31 14:54:08.025146 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.025125 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4"] Jul 31 14:54:08.045569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.045539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwg79\" (UniqueName: \"kubernetes.io/projected/8debb6b0-2e04-49db-a561-8415bbb062d8-kube-api-access-fwg79\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.045674 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.045577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.045735 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.045673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.146850 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.146822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwg79\" (UniqueName: \"kubernetes.io/projected/8debb6b0-2e04-49db-a561-8415bbb062d8-kube-api-access-fwg79\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.146981 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.146862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.146981 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.146963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.147246 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.147229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.147310 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.147296 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.156049 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.156027 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwg79\" (UniqueName: \"kubernetes.io/projected/8debb6b0-2e04-49db-a561-8415bbb062d8-kube-api-access-fwg79\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.312566 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.312544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:08.442886 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.442857 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4"] Jul 31 14:54:08.445266 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:54:08.445232 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8debb6b0_2e04_49db_a561_8415bbb062d8.slice/crio-5f0e2d8fc8ec61223b1a9a798092c2b78217ebc5a8d027f18d7d3dbaa9df2173 WatchSource:0}: Error finding container 5f0e2d8fc8ec61223b1a9a798092c2b78217ebc5a8d027f18d7d3dbaa9df2173: Status 404 returned error can't find the container with id 5f0e2d8fc8ec61223b1a9a798092c2b78217ebc5a8d027f18d7d3dbaa9df2173 Jul 31 14:54:08.447181 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.447163 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:54:08.636430 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:08.636363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" event={"ID":"8debb6b0-2e04-49db-a561-8415bbb062d8","Type":"ContainerStarted","Data":"5f0e2d8fc8ec61223b1a9a798092c2b78217ebc5a8d027f18d7d3dbaa9df2173"} Jul 31 14:54:14.664504 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:14.664467 2579 generic.go:356] "Generic (PLEG): container finished" podID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerID="f2109ad3e5e8fc416cc922e702e6ea9a1ccc5ee1cb3cd109e3be3b7cd12d3067" exitCode=0 Jul 31 14:54:14.664907 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:14.664550 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" event={"ID":"8debb6b0-2e04-49db-a561-8415bbb062d8","Type":"ContainerDied","Data":"f2109ad3e5e8fc416cc922e702e6ea9a1ccc5ee1cb3cd109e3be3b7cd12d3067"} Jul 31 14:54:17.677822 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:17.677788 2579 generic.go:356] "Generic (PLEG): container finished" podID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerID="48bf379384d624f6d8ff6122092ee66665d294351572cc4c8e0d64424bc13e8a" exitCode=0 Jul 31 14:54:17.678220 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:17.677877 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" event={"ID":"8debb6b0-2e04-49db-a561-8415bbb062d8","Type":"ContainerDied","Data":"48bf379384d624f6d8ff6122092ee66665d294351572cc4c8e0d64424bc13e8a"} Jul 31 14:54:24.715064 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:24.715027 2579 generic.go:356] "Generic (PLEG): container finished" podID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerID="9e313fcbe02b80ce545724c1906e1f7d2d89c4e3bba15cc7203ed228a303352e" exitCode=0 Jul 31 14:54:24.715524 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:24.715112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" event={"ID":"8debb6b0-2e04-49db-a561-8415bbb062d8","Type":"ContainerDied","Data":"9e313fcbe02b80ce545724c1906e1f7d2d89c4e3bba15cc7203ed228a303352e"} Jul 31 14:54:25.844004 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.843981 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:25.894016 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.893986 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-util\") pod \"8debb6b0-2e04-49db-a561-8415bbb062d8\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " Jul 31 14:54:25.894016 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.894020 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-bundle\") pod \"8debb6b0-2e04-49db-a561-8415bbb062d8\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " Jul 31 14:54:25.894230 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.894050 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwg79\" (UniqueName: \"kubernetes.io/projected/8debb6b0-2e04-49db-a561-8415bbb062d8-kube-api-access-fwg79\") pod \"8debb6b0-2e04-49db-a561-8415bbb062d8\" (UID: \"8debb6b0-2e04-49db-a561-8415bbb062d8\") " Jul 31 14:54:25.894592 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.894567 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-bundle" (OuterVolumeSpecName: "bundle") pod "8debb6b0-2e04-49db-a561-8415bbb062d8" (UID: "8debb6b0-2e04-49db-a561-8415bbb062d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:54:25.896294 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.896271 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8debb6b0-2e04-49db-a561-8415bbb062d8-kube-api-access-fwg79" (OuterVolumeSpecName: "kube-api-access-fwg79") pod "8debb6b0-2e04-49db-a561-8415bbb062d8" (UID: "8debb6b0-2e04-49db-a561-8415bbb062d8"). InnerVolumeSpecName "kube-api-access-fwg79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:54:25.898879 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.898852 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-util" (OuterVolumeSpecName: "util") pod "8debb6b0-2e04-49db-a561-8415bbb062d8" (UID: "8debb6b0-2e04-49db-a561-8415bbb062d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:54:25.994657 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.994603 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwg79\" (UniqueName: \"kubernetes.io/projected/8debb6b0-2e04-49db-a561-8415bbb062d8-kube-api-access-fwg79\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:54:25.994657 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.994626 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-util\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:54:25.994657 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:25.994635 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8debb6b0-2e04-49db-a561-8415bbb062d8-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:54:26.725176 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:26.725142 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" Jul 31 14:54:26.725176 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:26.725152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5s7jl4" event={"ID":"8debb6b0-2e04-49db-a561-8415bbb062d8","Type":"ContainerDied","Data":"5f0e2d8fc8ec61223b1a9a798092c2b78217ebc5a8d027f18d7d3dbaa9df2173"} Jul 31 14:54:26.725391 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:26.725209 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f0e2d8fc8ec61223b1a9a798092c2b78217ebc5a8d027f18d7d3dbaa9df2173" Jul 31 14:54:29.554142 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:29.554094 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:29.653419 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:29.653381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:31.738355 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738314 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp"] Jul 31 14:54:31.738822 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738791 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="pull" Jul 31 14:54:31.738822 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738809 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="pull" Jul 31 14:54:31.738928 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738844 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="util" Jul 31 14:54:31.738928 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738854 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="util" Jul 31 14:54:31.738928 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738869 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="extract" Jul 31 14:54:31.738928 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738877 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="extract" Jul 31 14:54:31.739148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.738990 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8debb6b0-2e04-49db-a561-8415bbb062d8" containerName="extract" Jul 31 14:54:31.787454 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.787421 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp"] Jul 31 14:54:31.787601 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.787525 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:31.791168 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.791144 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 31 14:54:31.791407 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.791392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 31 14:54:31.791602 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.791586 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 31 14:54:31.791682 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.791606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-kr75m\"" Jul 31 14:54:31.840503 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.840478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77c6b\" (UniqueName: \"kubernetes.io/projected/a3bb4838-12db-4392-982d-d3686e4ea4f4-kube-api-access-77c6b\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp\" (UID: \"a3bb4838-12db-4392-982d-d3686e4ea4f4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:31.840580 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.840521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a3bb4838-12db-4392-982d-d3686e4ea4f4-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp\" (UID: \"a3bb4838-12db-4392-982d-d3686e4ea4f4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:31.941028 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.941003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77c6b\" (UniqueName: \"kubernetes.io/projected/a3bb4838-12db-4392-982d-d3686e4ea4f4-kube-api-access-77c6b\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp\" (UID: \"a3bb4838-12db-4392-982d-d3686e4ea4f4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:31.941112 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.941038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a3bb4838-12db-4392-982d-d3686e4ea4f4-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp\" (UID: \"a3bb4838-12db-4392-982d-d3686e4ea4f4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:31.943427 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.943396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a3bb4838-12db-4392-982d-d3686e4ea4f4-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp\" (UID: \"a3bb4838-12db-4392-982d-d3686e4ea4f4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:31.950154 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:31.950133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77c6b\" (UniqueName: \"kubernetes.io/projected/a3bb4838-12db-4392-982d-d3686e4ea4f4-kube-api-access-77c6b\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp\" (UID: \"a3bb4838-12db-4392-982d-d3686e4ea4f4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:32.097683 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:32.097660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:32.264416 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:32.264380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp"] Jul 31 14:54:32.270875 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:54:32.270841 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bb4838_12db_4392_982d_d3686e4ea4f4.slice/crio-6e9a68764adc41e3ae6eeaa49700b731be9020919932b3c56f69dd5cf4cb6615 WatchSource:0}: Error finding container 6e9a68764adc41e3ae6eeaa49700b731be9020919932b3c56f69dd5cf4cb6615: Status 404 returned error can't find the container with id 6e9a68764adc41e3ae6eeaa49700b731be9020919932b3c56f69dd5cf4cb6615 Jul 31 14:54:32.751797 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:32.751756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" event={"ID":"a3bb4838-12db-4392-982d-d3686e4ea4f4","Type":"ContainerStarted","Data":"6e9a68764adc41e3ae6eeaa49700b731be9020919932b3c56f69dd5cf4cb6615"} Jul 31 14:54:35.769059 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:35.769024 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" event={"ID":"a3bb4838-12db-4392-982d-d3686e4ea4f4","Type":"ContainerStarted","Data":"faeac1b363a38f745fb558887d787ab5e3317a2ded76405b848a4190ab58edb4"} Jul 31 14:54:35.769463 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:35.769170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:54:35.791231 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:35.791187 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" podStartSLOduration=1.505963852 podStartE2EDuration="4.791172608s" totalImagesPullingTime="3.285208756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:35.790632176 +0000 UTC m=+397.250245551" watchObservedRunningTime="2026-07-31 14:54:35.791172608 +0000 UTC m=+397.250785985" Jul 31 14:54:36.000190 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.000095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:36.327809 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.327784 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:36.434579 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.434554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:36.771690 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.771608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:36.863185 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.863153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:36.956707 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.956682 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-jl64w"] Jul 31 14:54:36.959466 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.959447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:36.962646 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.962631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 31 14:54:36.963752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.963733 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-c9hsm\"" Jul 31 14:54:36.963884 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.963867 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 31 14:54:36.981784 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:36.981756 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-jl64w"] Jul 31 14:54:37.080647 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.080623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcsqz\" (UniqueName: \"kubernetes.io/projected/9b7320b2-8318-4a79-b870-bf34920cb716-kube-api-access-pcsqz\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.080799 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.080668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9b7320b2-8318-4a79-b870-bf34920cb716-certificates\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.080799 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.080759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9b7320b2-8318-4a79-b870-bf34920cb716-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.181694 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.181669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9b7320b2-8318-4a79-b870-bf34920cb716-certificates\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.181860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.181743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9b7320b2-8318-4a79-b870-bf34920cb716-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.181860 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.181764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsqz\" (UniqueName: \"kubernetes.io/projected/9b7320b2-8318-4a79-b870-bf34920cb716-kube-api-access-pcsqz\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.182130 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.182105 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9b7320b2-8318-4a79-b870-bf34920cb716-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.184318 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.184301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9b7320b2-8318-4a79-b870-bf34920cb716-certificates\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.192194 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.192172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcsqz\" (UniqueName: \"kubernetes.io/projected/9b7320b2-8318-4a79-b870-bf34920cb716-kube-api-access-pcsqz\") pod \"keda-metrics-apiserver-55557df8c-jl64w\" (UID: \"9b7320b2-8318-4a79-b870-bf34920cb716\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.270749 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.270510 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:37.344044 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.343859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:37.444542 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.444480 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-jl64w"] Jul 31 14:54:37.447923 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:54:37.447891 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7320b2_8318_4a79_b870_bf34920cb716.slice/crio-2d1c86044d68d945d291bd0104c67e6944d61a6bffd5245554af5d950847d565 WatchSource:0}: Error finding container 2d1c86044d68d945d291bd0104c67e6944d61a6bffd5245554af5d950847d565: Status 404 returned error can't find the container with id 2d1c86044d68d945d291bd0104c67e6944d61a6bffd5245554af5d950847d565 Jul 31 14:54:37.476300 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.476273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:37.780690 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.780643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" event={"ID":"9b7320b2-8318-4a79-b870-bf34920cb716","Type":"ContainerStarted","Data":"2d1c86044d68d945d291bd0104c67e6944d61a6bffd5245554af5d950847d565"} Jul 31 14:54:37.859418 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.859386 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c56d5c66-nnpzb"] Jul 31 14:54:37.865786 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.865760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.866521 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.866497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:37.960807 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.960764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c56d5c66-nnpzb"] Jul 31 14:54:37.989569 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-config\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.989711 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-trusted-ca-bundle\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.989711 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-oauth-serving-cert\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.989823 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-serving-cert\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.989823 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-oauth-config\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.989960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-service-ca\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:37.989960 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:37.989904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/93141fa9-e049-4ca8-ad78-a460628a9f7f-kube-api-access-znphn\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090621 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-oauth-config\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090621 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-service-ca\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090621 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/93141fa9-e049-4ca8-ad78-a460628a9f7f-kube-api-access-znphn\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090621 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-config\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-trusted-ca-bundle\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-oauth-serving-cert\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.090917 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.090871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-serving-cert\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.091424 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.091398 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-service-ca\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.091563 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.091483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-config\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.091563 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.091514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-oauth-serving-cert\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.091676 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.091598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93141fa9-e049-4ca8-ad78-a460628a9f7f-trusted-ca-bundle\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.093144 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.093128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-oauth-config\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.093356 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.093340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93141fa9-e049-4ca8-ad78-a460628a9f7f-console-serving-cert\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.109554 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.109526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/93141fa9-e049-4ca8-ad78-a460628a9f7f-kube-api-access-znphn\") pod \"console-68c56d5c66-nnpzb\" (UID: \"93141fa9-e049-4ca8-ad78-a460628a9f7f\") " pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.132524 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.132504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:38.174797 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.174770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:38.388926 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.388842 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c56d5c66-nnpzb"] Jul 31 14:54:38.393421 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:54:38.393395 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93141fa9_e049_4ca8_ad78_a460628a9f7f.slice/crio-fe6fd15ce4a1f1a6d6afb70c9e65c5ff62f36dcdb107b03782e4bb4261410546 WatchSource:0}: Error finding container fe6fd15ce4a1f1a6d6afb70c9e65c5ff62f36dcdb107b03782e4bb4261410546: Status 404 returned error can't find the container with id fe6fd15ce4a1f1a6d6afb70c9e65c5ff62f36dcdb107b03782e4bb4261410546 Jul 31 14:54:38.432203 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.432173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:38.591393 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.591365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:38.786597 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.786565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c56d5c66-nnpzb" event={"ID":"93141fa9-e049-4ca8-ad78-a460628a9f7f","Type":"ContainerStarted","Data":"c81cb84d787008e1962e61bca824e6b9c771e38db852d66297712901b471fadf"} Jul 31 14:54:38.787034 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.786641 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c56d5c66-nnpzb" event={"ID":"93141fa9-e049-4ca8-ad78-a460628a9f7f","Type":"ContainerStarted","Data":"fe6fd15ce4a1f1a6d6afb70c9e65c5ff62f36dcdb107b03782e4bb4261410546"} Jul 31 14:54:38.802627 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.802603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:38.840626 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:38.840575 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c56d5c66-nnpzb" podStartSLOduration=1.840558516 podStartE2EDuration="1.840558516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:38.837949157 +0000 UTC m=+400.297562531" watchObservedRunningTime="2026-07-31 14:54:38.840558516 +0000 UTC m=+400.300171963" Jul 31 14:54:40.800179 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:40.800147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" event={"ID":"9b7320b2-8318-4a79-b870-bf34920cb716","Type":"ContainerStarted","Data":"e0a794370658c9279f7646554c066a063859b2d812cf80ac983a6b55d41bcaa2"} Jul 31 14:54:40.800624 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:40.800273 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:40.822469 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:40.822376 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" podStartSLOduration=1.701173555 podStartE2EDuration="4.822360983s" totalImagesPullingTime="3.121187428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:40.821409177 +0000 UTC m=+402.281022556" watchObservedRunningTime="2026-07-31 14:54:40.822360983 +0000 UTC m=+402.281974361" Jul 31 14:54:48.175004 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:48.174966 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:48.175004 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:48.175013 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:48.180057 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:48.180028 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:48.839158 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:48.839132 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c56d5c66-nnpzb" Jul 31 14:54:48.899104 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:48.899070 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d46c89b7c-wwds8"] Jul 31 14:54:49.037397 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:49.037364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:49.139326 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:49.139247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:49.211227 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:49.211198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:51.808787 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:51.808758 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-jl64w" Jul 31 14:54:56.776947 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:54:56.776914 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-qd9fp" Jul 31 14:55:13.918991 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:13.918919 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d46c89b7c-wwds8" podUID="85a2c6e2-24d1-493a-8e4b-be645c38dbaa" containerName="console" containerID="cri-o://fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d" gracePeriod=15 Jul 31 14:55:14.161369 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.161346 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:55:14.190142 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190079 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-oauth-config\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190244 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190148 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-trusted-ca-bundle\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190244 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190184 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-oauth-serving-cert\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190244 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190221 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-config\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190378 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190264 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-service-ca\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190378 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190297 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-serving-cert\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190378 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190326 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsfgq\" (UniqueName: \"kubernetes.io/projected/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-kube-api-access-gsfgq\") pod \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\" (UID: \"85a2c6e2-24d1-493a-8e4b-be645c38dbaa\") " Jul 31 14:55:14.190606 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190565 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:14.190606 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190590 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:14.190759 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190611 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-config" (OuterVolumeSpecName: "console-config") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:14.190759 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.190647 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-service-ca" (OuterVolumeSpecName: "service-ca") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:14.192408 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.192377 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:55:14.192795 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.192774 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-kube-api-access-gsfgq" (OuterVolumeSpecName: "kube-api-access-gsfgq") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "kube-api-access-gsfgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:55:14.192866 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.192839 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "85a2c6e2-24d1-493a-8e4b-be645c38dbaa" (UID: "85a2c6e2-24d1-493a-8e4b-be645c38dbaa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:55:14.291646 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291609 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.291646 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291639 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsfgq\" (UniqueName: \"kubernetes.io/projected/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-kube-api-access-gsfgq\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.291646 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291651 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-oauth-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.291881 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291663 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-trusted-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.291881 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291674 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-oauth-serving-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.291881 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291685 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-console-config\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.291881 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.291696 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85a2c6e2-24d1-493a-8e4b-be645c38dbaa-service-ca\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:55:14.947329 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.947298 2579 generic.go:356] "Generic (PLEG): container finished" podID="85a2c6e2-24d1-493a-8e4b-be645c38dbaa" containerID="fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d" exitCode=0 Jul 31 14:55:14.947839 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.947355 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46c89b7c-wwds8" Jul 31 14:55:14.947839 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.947394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46c89b7c-wwds8" event={"ID":"85a2c6e2-24d1-493a-8e4b-be645c38dbaa","Type":"ContainerDied","Data":"fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d"} Jul 31 14:55:14.947839 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.947448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46c89b7c-wwds8" event={"ID":"85a2c6e2-24d1-493a-8e4b-be645c38dbaa","Type":"ContainerDied","Data":"ea5ce718a776e91d294cc9a32bb85c8564afbc2f800bf740e954e61be8035b2d"} Jul 31 14:55:14.947839 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.947470 2579 scope.go:117] "RemoveContainer" containerID="fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d" Jul 31 14:55:14.956191 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.956175 2579 scope.go:117] "RemoveContainer" containerID="fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d" Jul 31 14:55:14.956453 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:55:14.956435 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d\": container with ID starting with fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d not found: ID does not exist" containerID="fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d" Jul 31 14:55:14.956519 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.956460 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d"} err="failed to get container status \"fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d\": rpc error: code = NotFound desc = could not find container \"fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d\": container with ID starting with fe2bf1ca9b97f30e21e2aa1f1716c579777fe9ca37f285737905477fb46c3f8d not found: ID does not exist" Jul 31 14:55:14.976264 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.976233 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d46c89b7c-wwds8"] Jul 31 14:55:14.988298 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:14.988273 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d46c89b7c-wwds8"] Jul 31 14:55:15.047234 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:15.047206 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a2c6e2-24d1-493a-8e4b-be645c38dbaa" path="/var/lib/kubelet/pods/85a2c6e2-24d1-493a-8e4b-be645c38dbaa/volumes" Jul 31 14:55:28.392160 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:28.392123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.490087 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:28.490057 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:59.375252 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.375216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:59.474057 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.474020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:59.488823 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.488794 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-p47zc"] Jul 31 14:55:59.489304 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.489289 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a2c6e2-24d1-493a-8e4b-be645c38dbaa" containerName="console" Jul 31 14:55:59.489370 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.489307 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a2c6e2-24d1-493a-8e4b-be645c38dbaa" containerName="console" Jul 31 14:55:59.489424 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.489405 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85a2c6e2-24d1-493a-8e4b-be645c38dbaa" containerName="console" Jul 31 14:55:59.493006 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.492989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:55:59.498078 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.498053 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 31 14:55:59.498534 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.498510 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-xthmp\"" Jul 31 14:55:59.498644 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.498557 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 31 14:55:59.498853 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.498838 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 31 14:55:59.501419 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.501397 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-lwrcr"] Jul 31 14:55:59.504677 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.504661 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.507399 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.507383 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-5f486\"" Jul 31 14:55:59.510295 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.510268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 31 14:55:59.520878 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.520855 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-p47zc"] Jul 31 14:55:59.522762 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.522741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-lwrcr"] Jul 31 14:55:59.543376 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.543348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4snb\" (UniqueName: \"kubernetes.io/projected/f11249ce-8081-49e4-9887-123ef9822bc0-kube-api-access-h4snb\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:55:59.543653 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.543625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:55:59.644578 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.644504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:55:59.644578 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.644555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4snb\" (UniqueName: \"kubernetes.io/projected/f11249ce-8081-49e4-9887-123ef9822bc0-kube-api-access-h4snb\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:55:59.644757 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:55:59.644661 2579 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 31 14:55:59.644757 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.644673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbj4j\" (UniqueName: \"kubernetes.io/projected/3ad60214-3e65-4953-bf8b-8507eb987b89-kube-api-access-wbj4j\") pod \"llmisvc-controller-manager-654c557856-lwrcr\" (UID: \"3ad60214-3e65-4953-bf8b-8507eb987b89\") " pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.644757 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:55:59.644734 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert podName:f11249ce-8081-49e4-9887-123ef9822bc0 nodeName:}" failed. No retries permitted until 2026-07-31 14:56:00.144713759 +0000 UTC m=+481.604327119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert") pod "kserve-controller-manager-fcc9dd4db-p47zc" (UID: "f11249ce-8081-49e4-9887-123ef9822bc0") : secret "kserve-webhook-server-cert" not found Jul 31 14:55:59.644898 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.644755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ad60214-3e65-4953-bf8b-8507eb987b89-cert\") pod \"llmisvc-controller-manager-654c557856-lwrcr\" (UID: \"3ad60214-3e65-4953-bf8b-8507eb987b89\") " pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.656391 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.656365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4snb\" (UniqueName: \"kubernetes.io/projected/f11249ce-8081-49e4-9887-123ef9822bc0-kube-api-access-h4snb\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:55:59.677628 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.677603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:59.745157 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.745132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbj4j\" (UniqueName: \"kubernetes.io/projected/3ad60214-3e65-4953-bf8b-8507eb987b89-kube-api-access-wbj4j\") pod \"llmisvc-controller-manager-654c557856-lwrcr\" (UID: \"3ad60214-3e65-4953-bf8b-8507eb987b89\") " pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.745248 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.745161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ad60214-3e65-4953-bf8b-8507eb987b89-cert\") pod \"llmisvc-controller-manager-654c557856-lwrcr\" (UID: \"3ad60214-3e65-4953-bf8b-8507eb987b89\") " pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.747481 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.747463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ad60214-3e65-4953-bf8b-8507eb987b89-cert\") pod \"llmisvc-controller-manager-654c557856-lwrcr\" (UID: \"3ad60214-3e65-4953-bf8b-8507eb987b89\") " pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.755257 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.755237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbj4j\" (UniqueName: \"kubernetes.io/projected/3ad60214-3e65-4953-bf8b-8507eb987b89-kube-api-access-wbj4j\") pod \"llmisvc-controller-manager-654c557856-lwrcr\" (UID: \"3ad60214-3e65-4953-bf8b-8507eb987b89\") " pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.788148 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.788130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:59.814598 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.814577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:55:59.956211 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.955825 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-lwrcr"] Jul 31 14:55:59.957524 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:55:59.957501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:59.958761 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:55:59.958738 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ad60214_3e65_4953_bf8b_8507eb987b89.slice/crio-b284264bea03e7faa5a82a265af8244a51f62e1809401adf0db5ce2234324173 WatchSource:0}: Error finding container b284264bea03e7faa5a82a265af8244a51f62e1809401adf0db5ce2234324173: Status 404 returned error can't find the container with id b284264bea03e7faa5a82a265af8244a51f62e1809401adf0db5ce2234324173 Jul 31 14:56:00.147567 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.147541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:00.150016 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.149974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert\") pod \"kserve-controller-manager-fcc9dd4db-p47zc\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:00.165432 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.165407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" event={"ID":"3ad60214-3e65-4953-bf8b-8507eb987b89","Type":"ContainerStarted","Data":"b284264bea03e7faa5a82a265af8244a51f62e1809401adf0db5ce2234324173"} Jul 31 14:56:00.404102 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.404040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:00.544611 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.544581 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-p47zc"] Jul 31 14:56:00.567469 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:56:00.567437 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11249ce_8081_49e4_9887_123ef9822bc0.slice/crio-b41decd675d64682fc3697dbe5e043b56c6870acdf5968d14832e6b180deb670 WatchSource:0}: Error finding container b41decd675d64682fc3697dbe5e043b56c6870acdf5968d14832e6b180deb670: Status 404 returned error can't find the container with id b41decd675d64682fc3697dbe5e043b56c6870acdf5968d14832e6b180deb670 Jul 31 14:56:00.683793 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.683727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:00.783724 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.783685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:00.858619 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:00.858588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:01.172833 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:01.172794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" event={"ID":"f11249ce-8081-49e4-9887-123ef9822bc0","Type":"ContainerStarted","Data":"b41decd675d64682fc3697dbe5e043b56c6870acdf5968d14832e6b180deb670"} Jul 31 14:56:04.188345 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:04.188303 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" event={"ID":"3ad60214-3e65-4953-bf8b-8507eb987b89","Type":"ContainerStarted","Data":"9a70435537ba36502cfe30f37540d89e6cf330dacfacc2cbca6f7d6fca69c142"} Jul 31 14:56:04.188787 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:04.188379 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:56:04.189916 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:04.189893 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" event={"ID":"f11249ce-8081-49e4-9887-123ef9822bc0","Type":"ContainerStarted","Data":"5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958"} Jul 31 14:56:04.190016 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:04.189978 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:04.233488 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:04.233438 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" podStartSLOduration=1.602185688 podStartE2EDuration="5.233424564s" totalImagesPullingTime="3.631238876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:56:04.212474563 +0000 UTC m=+485.672087940" watchObservedRunningTime="2026-07-31 14:56:04.233424564 +0000 UTC m=+485.693037942" Jul 31 14:56:04.233752 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:04.233732 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" podStartSLOduration=2.164347153 podStartE2EDuration="5.233723373s" totalImagesPullingTime="3.06937622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:56:04.231094427 +0000 UTC m=+485.690707805" watchObservedRunningTime="2026-07-31 14:56:04.233723373 +0000 UTC m=+485.693336751" Jul 31 14:56:27.255959 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:27.255907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:35.196009 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:35.195983 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-lwrcr" Jul 31 14:56:35.199251 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:35.199230 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:45.023323 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.023285 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-p47zc"] Jul 31 14:56:45.023785 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.023504 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" podUID="f11249ce-8081-49e4-9887-123ef9822bc0" containerName="manager" containerID="cri-o://5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958" gracePeriod=10 Jul 31 14:56:45.063617 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.063595 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-c7k5k"] Jul 31 14:56:45.066041 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.066023 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.083776 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.083753 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-c7k5k"] Jul 31 14:56:45.193474 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.193445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7pxt\" (UniqueName: \"kubernetes.io/projected/fa127f85-8294-4e0a-90ad-4b2f222e2fcf-kube-api-access-v7pxt\") pod \"kserve-controller-manager-fcc9dd4db-c7k5k\" (UID: \"fa127f85-8294-4e0a-90ad-4b2f222e2fcf\") " pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.193668 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.193644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa127f85-8294-4e0a-90ad-4b2f222e2fcf-cert\") pod \"kserve-controller-manager-fcc9dd4db-c7k5k\" (UID: \"fa127f85-8294-4e0a-90ad-4b2f222e2fcf\") " pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.263511 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.263486 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:45.294540 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.294516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa127f85-8294-4e0a-90ad-4b2f222e2fcf-cert\") pod \"kserve-controller-manager-fcc9dd4db-c7k5k\" (UID: \"fa127f85-8294-4e0a-90ad-4b2f222e2fcf\") " pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.294672 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.294591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7pxt\" (UniqueName: \"kubernetes.io/projected/fa127f85-8294-4e0a-90ad-4b2f222e2fcf-kube-api-access-v7pxt\") pod \"kserve-controller-manager-fcc9dd4db-c7k5k\" (UID: \"fa127f85-8294-4e0a-90ad-4b2f222e2fcf\") " pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.297165 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.297139 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa127f85-8294-4e0a-90ad-4b2f222e2fcf-cert\") pod \"kserve-controller-manager-fcc9dd4db-c7k5k\" (UID: \"fa127f85-8294-4e0a-90ad-4b2f222e2fcf\") " pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.303799 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.303774 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7pxt\" (UniqueName: \"kubernetes.io/projected/fa127f85-8294-4e0a-90ad-4b2f222e2fcf-kube-api-access-v7pxt\") pod \"kserve-controller-manager-fcc9dd4db-c7k5k\" (UID: \"fa127f85-8294-4e0a-90ad-4b2f222e2fcf\") " pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.367731 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.367695 2579 generic.go:356] "Generic (PLEG): container finished" podID="f11249ce-8081-49e4-9887-123ef9822bc0" containerID="5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958" exitCode=0 Jul 31 14:56:45.367846 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.367736 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" Jul 31 14:56:45.367846 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.367777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" event={"ID":"f11249ce-8081-49e4-9887-123ef9822bc0","Type":"ContainerDied","Data":"5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958"} Jul 31 14:56:45.367846 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.367828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" event={"ID":"f11249ce-8081-49e4-9887-123ef9822bc0","Type":"ContainerDied","Data":"b41decd675d64682fc3697dbe5e043b56c6870acdf5968d14832e6b180deb670"} Jul 31 14:56:45.368003 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.367849 2579 scope.go:117] "RemoveContainer" containerID="5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958" Jul 31 14:56:45.377678 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.377660 2579 scope.go:117] "RemoveContainer" containerID="5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958" Jul 31 14:56:45.377983 ip-10-0-136-197 kubenswrapper[2579]: E0731 14:56:45.377966 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958\": container with ID starting with 5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958 not found: ID does not exist" containerID="5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958" Jul 31 14:56:45.378034 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.377991 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958"} err="failed to get container status \"5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958\": rpc error: code = NotFound desc = could not find container \"5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958\": container with ID starting with 5830052d61eccbf2a6dc4bf5082aa667ee2dacafe6dab760679e492d6a0fa958 not found: ID does not exist" Jul 31 14:56:45.395310 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.395291 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert\") pod \"f11249ce-8081-49e4-9887-123ef9822bc0\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " Jul 31 14:56:45.395400 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.395327 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4snb\" (UniqueName: \"kubernetes.io/projected/f11249ce-8081-49e4-9887-123ef9822bc0-kube-api-access-h4snb\") pod \"f11249ce-8081-49e4-9887-123ef9822bc0\" (UID: \"f11249ce-8081-49e4-9887-123ef9822bc0\") " Jul 31 14:56:45.397404 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.397382 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert" (OuterVolumeSpecName: "cert") pod "f11249ce-8081-49e4-9887-123ef9822bc0" (UID: "f11249ce-8081-49e4-9887-123ef9822bc0"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:56:45.397500 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.397431 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11249ce-8081-49e4-9887-123ef9822bc0-kube-api-access-h4snb" (OuterVolumeSpecName: "kube-api-access-h4snb") pod "f11249ce-8081-49e4-9887-123ef9822bc0" (UID: "f11249ce-8081-49e4-9887-123ef9822bc0"). InnerVolumeSpecName "kube-api-access-h4snb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:56:45.402577 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.402559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:45.496644 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.496616 2579 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11249ce-8081-49e4-9887-123ef9822bc0-cert\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:56:45.496760 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.496649 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4snb\" (UniqueName: \"kubernetes.io/projected/f11249ce-8081-49e4-9887-123ef9822bc0-kube-api-access-h4snb\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 14:56:45.538728 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.538703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-c7k5k"] Jul 31 14:56:45.540865 ip-10-0-136-197 kubenswrapper[2579]: W0731 14:56:45.540840 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa127f85_8294_4e0a_90ad_4b2f222e2fcf.slice/crio-101f5067cb559cf03c5bd12d29fecbad1a39b90aacfbc76e0c13767365a57885 WatchSource:0}: Error finding container 101f5067cb559cf03c5bd12d29fecbad1a39b90aacfbc76e0c13767365a57885: Status 404 returned error can't find the container with id 101f5067cb559cf03c5bd12d29fecbad1a39b90aacfbc76e0c13767365a57885 Jul 31 14:56:45.693817 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.693791 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-p47zc"] Jul 31 14:56:45.700131 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:45.700103 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-fcc9dd4db-p47zc"] Jul 31 14:56:46.374584 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:46.374549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" event={"ID":"fa127f85-8294-4e0a-90ad-4b2f222e2fcf","Type":"ContainerStarted","Data":"cf73bca368589ba02bddeb2c314fa6a47dfadfa0e25bb89b2382c5eabb2a6a6e"} Jul 31 14:56:46.374957 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:46.374625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" event={"ID":"fa127f85-8294-4e0a-90ad-4b2f222e2fcf","Type":"ContainerStarted","Data":"101f5067cb559cf03c5bd12d29fecbad1a39b90aacfbc76e0c13767365a57885"} Jul 31 14:56:46.374957 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:46.374707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:56:46.399655 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:46.399612 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" podStartSLOduration=0.955491206 podStartE2EDuration="1.399599208s" totalImagesPullingTime="444.108002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:56:46.397842494 +0000 UTC m=+527.857455898" watchObservedRunningTime="2026-07-31 14:56:46.399599208 +0000 UTC m=+527.859212586" Jul 31 14:56:47.042506 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:47.042467 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f11249ce-8081-49e4-9887-123ef9822bc0" path="/var/lib/kubelet/pods/f11249ce-8081-49e4-9887-123ef9822bc0/volumes" Jul 31 14:56:50.195120 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:56:50.195016 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/kserve-controller-manager-fcc9dd4db-p47zc" podUID="f11249ce-8081-49e4-9887-123ef9822bc0" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.30:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 31 14:57:17.384528 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:17.384497 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-fcc9dd4db-c7k5k" Jul 31 14:57:18.824150 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:18.824111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:18.927391 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:18.927349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:19.153145 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:19.153071 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:19.255930 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:19.255906 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:19.776539 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:19.776510 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:19.915064 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:19.915036 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:22.492105 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:22.492080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:58.943626 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:58.943596 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:57:58.944588 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:57:58.944568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 14:58:54.138606 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:58:54.138569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:54.225625 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:58:54.225593 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:05.554103 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:05.554069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:05.882120 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:05.882037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:05.980158 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:05.980125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:06.062784 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:06.062750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:06.204250 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:06.204168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:06.344142 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:06.344100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:06.496913 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:06.496829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:06.596227 ip-10-0-136-197 kubenswrapper[2579]: I0731 14:59:06.596199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:25.707861 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.707827 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6"] Jul 31 15:00:25.708365 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.708348 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11249ce-8081-49e4-9887-123ef9822bc0" containerName="manager" Jul 31 15:00:25.708412 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.708368 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11249ce-8081-49e4-9887-123ef9822bc0" containerName="manager" Jul 31 15:00:25.708468 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.708457 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11249ce-8081-49e4-9887-123ef9822bc0" containerName="manager" Jul 31 15:00:25.711788 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.711772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:25.713817 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.713792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:25.713924 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.713851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f34d81-40ba-45bd-ab27-02bbaad774ba-openshift-service-ca-bundle\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:25.714644 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.714619 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-e9535-kube-rbac-proxy-sar-config\"" Jul 31 15:00:25.714644 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.714634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-e9535-serving-cert\"" Jul 31 15:00:25.714795 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.714695 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hpn59\"" Jul 31 15:00:25.714795 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.714717 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 31 15:00:25.727160 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.727140 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6"] Jul 31 15:00:25.739985 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.739962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:25.815175 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.815147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:25.815328 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.815203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f34d81-40ba-45bd-ab27-02bbaad774ba-openshift-service-ca-bundle\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:25.815328 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:00:25.815317 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-e9535-serving-cert: secret "switch-graph-e9535-serving-cert" not found Jul 31 15:00:25.815446 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:00:25.815409 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls podName:48f34d81-40ba-45bd-ab27-02bbaad774ba nodeName:}" failed. No retries permitted until 2026-07-31 15:00:26.315392075 +0000 UTC m=+747.775005435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls") pod "switch-graph-e9535-68fb6f49bc-d8ks6" (UID: "48f34d81-40ba-45bd-ab27-02bbaad774ba") : secret "switch-graph-e9535-serving-cert" not found Jul 31 15:00:25.815836 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:25.815813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f34d81-40ba-45bd-ab27-02bbaad774ba-openshift-service-ca-bundle\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:26.318747 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:26.318719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:26.318908 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:00:26.318891 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-e9535-serving-cert: secret "switch-graph-e9535-serving-cert" not found Jul 31 15:00:26.319016 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:00:26.318992 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls podName:48f34d81-40ba-45bd-ab27-02bbaad774ba nodeName:}" failed. No retries permitted until 2026-07-31 15:00:27.318969424 +0000 UTC m=+748.778582797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls") pod "switch-graph-e9535-68fb6f49bc-d8ks6" (UID: "48f34d81-40ba-45bd-ab27-02bbaad774ba") : secret "switch-graph-e9535-serving-cert" not found Jul 31 15:00:27.324917 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:27.324880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:27.327595 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:27.327563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") pod \"switch-graph-e9535-68fb6f49bc-d8ks6\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:27.522692 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:27.522668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:27.657426 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:27.657402 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6"] Jul 31 15:00:27.660313 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:00:27.660286 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f34d81_40ba_45bd_ab27_02bbaad774ba.slice/crio-ea66063a720cd15545d1f250294f86b5124ab162bbabcfc4ad40cc6a7d0df5fc WatchSource:0}: Error finding container ea66063a720cd15545d1f250294f86b5124ab162bbabcfc4ad40cc6a7d0df5fc: Status 404 returned error can't find the container with id ea66063a720cd15545d1f250294f86b5124ab162bbabcfc4ad40cc6a7d0df5fc Jul 31 15:00:27.662595 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:27.662576 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 15:00:28.381962 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:28.381913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" event={"ID":"48f34d81-40ba-45bd-ab27-02bbaad774ba","Type":"ContainerStarted","Data":"ea66063a720cd15545d1f250294f86b5124ab162bbabcfc4ad40cc6a7d0df5fc"} Jul 31 15:00:29.316073 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:29.316028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:30.392715 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:30.392632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" event={"ID":"48f34d81-40ba-45bd-ab27-02bbaad774ba","Type":"ContainerStarted","Data":"a719a2274b1cdc2df960dc80088fb8cb04689f80081fbf605f42304fa0ff6643"} Jul 31 15:00:30.392715 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:30.392696 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:36.403229 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:36.403199 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:36.426525 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:36.426471 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podStartSLOduration=9.000524461 podStartE2EDuration="11.426455324s" totalImagesPullingTime="2.425930863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:00:30.430571834 +0000 UTC m=+751.890185213" watchObservedRunningTime="2026-07-31 15:00:36.426455324 +0000 UTC m=+757.886068995" Jul 31 15:00:39.937687 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:39.937649 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6"] Jul 31 15:00:39.938138 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:39.937896 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" containerID="cri-o://a719a2274b1cdc2df960dc80088fb8cb04689f80081fbf605f42304fa0ff6643" gracePeriod=30 Jul 31 15:00:39.966002 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:39.965974 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:40.165282 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:40.165249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:40.277113 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:40.277037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:40.380657 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:40.380629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:40.446350 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:40.446321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:41.400586 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:41.400543 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:00:46.400597 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:46.400560 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:00:51.401007 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:51.400970 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:00:51.401365 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:51.401061 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:00:56.400662 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:00:56.400625 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:01.401012 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:01.400972 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:06.400579 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:06.400534 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:10.573749 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.573716 2579 generic.go:356] "Generic (PLEG): container finished" podID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerID="a719a2274b1cdc2df960dc80088fb8cb04689f80081fbf605f42304fa0ff6643" exitCode=0 Jul 31 15:01:10.574130 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.573785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" event={"ID":"48f34d81-40ba-45bd-ab27-02bbaad774ba","Type":"ContainerDied","Data":"a719a2274b1cdc2df960dc80088fb8cb04689f80081fbf605f42304fa0ff6643"} Jul 31 15:01:10.574130 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.573837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" event={"ID":"48f34d81-40ba-45bd-ab27-02bbaad774ba","Type":"ContainerDied","Data":"ea66063a720cd15545d1f250294f86b5124ab162bbabcfc4ad40cc6a7d0df5fc"} Jul 31 15:01:10.574130 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.573859 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea66063a720cd15545d1f250294f86b5124ab162bbabcfc4ad40cc6a7d0df5fc" Jul 31 15:01:10.579139 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.579120 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:01:10.662151 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.662128 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") pod \"48f34d81-40ba-45bd-ab27-02bbaad774ba\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " Jul 31 15:01:10.662262 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.662252 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f34d81-40ba-45bd-ab27-02bbaad774ba-openshift-service-ca-bundle\") pod \"48f34d81-40ba-45bd-ab27-02bbaad774ba\" (UID: \"48f34d81-40ba-45bd-ab27-02bbaad774ba\") " Jul 31 15:01:10.662571 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.662552 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48f34d81-40ba-45bd-ab27-02bbaad774ba-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "48f34d81-40ba-45bd-ab27-02bbaad774ba" (UID: "48f34d81-40ba-45bd-ab27-02bbaad774ba"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:10.664327 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.664308 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "48f34d81-40ba-45bd-ab27-02bbaad774ba" (UID: "48f34d81-40ba-45bd-ab27-02bbaad774ba"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:01:10.763478 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.763416 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48f34d81-40ba-45bd-ab27-02bbaad774ba-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:01:10.763478 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:10.763443 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34d81-40ba-45bd-ab27-02bbaad774ba-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:01:11.578150 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:11.578122 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6" Jul 31 15:01:11.594601 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:11.594564 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6"] Jul 31 15:01:11.598674 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:11.598651 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e9535-68fb6f49bc-d8ks6"] Jul 31 15:01:13.043136 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:13.043092 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" path="/var/lib/kubelet/pods/48f34d81-40ba-45bd-ab27-02bbaad774ba/volumes" Jul 31 15:01:25.695458 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.695415 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2"] Jul 31 15:01:25.695851 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.695791 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" Jul 31 15:01:25.695851 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.695805 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" Jul 31 15:01:25.695989 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.695863 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f34d81-40ba-45bd-ab27-02bbaad774ba" containerName="switch-graph-e9535" Jul 31 15:01:25.698999 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.698980 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:25.701859 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.701839 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hpn59\"" Jul 31 15:01:25.702269 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.702249 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 31 15:01:25.702373 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.702248 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Jul 31 15:01:25.702436 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.702423 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\"" Jul 31 15:01:25.703323 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.703301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:25.708348 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.708329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2"] Jul 31 15:01:25.802203 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.802173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:25.880273 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.880231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-proxy-tls\") pod \"model-chainer-8c9487985-fvxx2\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:25.880432 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.880304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-openshift-service-ca-bundle\") pod \"model-chainer-8c9487985-fvxx2\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:25.981763 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.981692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-proxy-tls\") pod \"model-chainer-8c9487985-fvxx2\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:25.981763 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.981738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-openshift-service-ca-bundle\") pod \"model-chainer-8c9487985-fvxx2\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:25.982375 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.982358 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-openshift-service-ca-bundle\") pod \"model-chainer-8c9487985-fvxx2\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:25.984262 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:25.984233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-proxy-tls\") pod \"model-chainer-8c9487985-fvxx2\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:26.012233 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:26.012211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:26.141882 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:26.141850 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2"] Jul 31 15:01:26.145227 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:01:26.145195 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824e8e17_9d3b_42be_8ea8_b5f2ced26d8b.slice/crio-85bf84d27ea0709b99b087c43469216ca387c70634c661228b0e051fa06877b9 WatchSource:0}: Error finding container 85bf84d27ea0709b99b087c43469216ca387c70634c661228b0e051fa06877b9: Status 404 returned error can't find the container with id 85bf84d27ea0709b99b087c43469216ca387c70634c661228b0e051fa06877b9 Jul 31 15:01:26.644875 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:26.644840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" event={"ID":"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b","Type":"ContainerStarted","Data":"abff2f102db47a9ccd5790e0b9e588baef553b1451a2e221a5e6d17fd4759929"} Jul 31 15:01:26.645111 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:26.644894 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" event={"ID":"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b","Type":"ContainerStarted","Data":"85bf84d27ea0709b99b087c43469216ca387c70634c661228b0e051fa06877b9"} Jul 31 15:01:26.645111 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:26.644963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:26.662758 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:26.662713 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podStartSLOduration=1.662698171 podStartE2EDuration="1.662698171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:01:26.661355006 +0000 UTC m=+808.120968397" watchObservedRunningTime="2026-07-31 15:01:26.662698171 +0000 UTC m=+808.122311548" Jul 31 15:01:32.657203 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:32.657174 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:35.791798 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:35.791768 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2"] Jul 31 15:01:35.792178 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:35.791999 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" containerID="cri-o://abff2f102db47a9ccd5790e0b9e588baef553b1451a2e221a5e6d17fd4759929" gracePeriod=30 Jul 31 15:01:35.813765 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:35.813742 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:35.936877 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:35.936840 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:36.027421 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:36.027390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:36.100302 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:36.100217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:36.172126 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:36.172096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:37.653870 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:37.653832 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:38.382768 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:38.382734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:40.220073 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.220040 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x"] Jul 31 15:01:40.223565 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.223542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.226559 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.226534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7b0b5-serving-cert\"" Jul 31 15:01:40.226819 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.226534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7b0b5-kube-rbac-proxy-sar-config\"" Jul 31 15:01:40.233816 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.233794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x"] Jul 31 15:01:40.277763 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.277739 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:40.291165 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.291136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c0fa4e2-4e21-4960-a822-32532eed1a5c-openshift-service-ca-bundle\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.291266 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.291187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.392241 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.392216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c0fa4e2-4e21-4960-a822-32532eed1a5c-openshift-service-ca-bundle\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.392339 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.392254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.392385 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:01:40.392375 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-7b0b5-serving-cert: secret "switch-graph-7b0b5-serving-cert" not found Jul 31 15:01:40.392433 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:01:40.392424 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls podName:9c0fa4e2-4e21-4960-a822-32532eed1a5c nodeName:}" failed. No retries permitted until 2026-07-31 15:01:40.892409735 +0000 UTC m=+822.352023091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls") pod "switch-graph-7b0b5-5859dbd5c9-v6w2x" (UID: "9c0fa4e2-4e21-4960-a822-32532eed1a5c") : secret "switch-graph-7b0b5-serving-cert" not found Jul 31 15:01:40.392769 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.392750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c0fa4e2-4e21-4960-a822-32532eed1a5c-openshift-service-ca-bundle\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.462905 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.462878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:40.895841 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.895801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:40.898325 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:40.898302 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls\") pod \"switch-graph-7b0b5-5859dbd5c9-v6w2x\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:41.135548 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:41.135523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:41.264041 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:41.264017 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x"] Jul 31 15:01:41.265907 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:01:41.265870 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0fa4e2_4e21_4960_a822_32532eed1a5c.slice/crio-e66a9e2f308cec2d49d84d692d62fb4d684c93b6452ebb7632eb17816eb3f8da WatchSource:0}: Error finding container e66a9e2f308cec2d49d84d692d62fb4d684c93b6452ebb7632eb17816eb3f8da: Status 404 returned error can't find the container with id e66a9e2f308cec2d49d84d692d62fb4d684c93b6452ebb7632eb17816eb3f8da Jul 31 15:01:41.720762 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:41.720728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" event={"ID":"9c0fa4e2-4e21-4960-a822-32532eed1a5c","Type":"ContainerStarted","Data":"f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14"} Jul 31 15:01:41.720912 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:41.720783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" event={"ID":"9c0fa4e2-4e21-4960-a822-32532eed1a5c","Type":"ContainerStarted","Data":"e66a9e2f308cec2d49d84d692d62fb4d684c93b6452ebb7632eb17816eb3f8da"} Jul 31 15:01:41.720912 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:41.720856 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:41.739823 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:41.739766 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podStartSLOduration=1.739749 podStartE2EDuration="1.739749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:01:41.738681669 +0000 UTC m=+823.198295050" watchObservedRunningTime="2026-07-31 15:01:41.739749 +0000 UTC m=+823.199362423" Jul 31 15:01:42.653767 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:42.653733 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:47.654597 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:47.654547 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:47.655097 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:47.654682 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:01:47.731886 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:47.731861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:01:50.156170 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:50.156123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:52.653802 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:52.653766 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:01:57.653536 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:01:57.653500 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:02:02.654505 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:02.654468 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:02:05.834993 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:05.834965 2579 generic.go:356] "Generic (PLEG): container finished" podID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerID="abff2f102db47a9ccd5790e0b9e588baef553b1451a2e221a5e6d17fd4759929" exitCode=0 Jul 31 15:02:05.835293 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:05.835033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" event={"ID":"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b","Type":"ContainerDied","Data":"abff2f102db47a9ccd5790e0b9e588baef553b1451a2e221a5e6d17fd4759929"} Jul 31 15:02:06.437148 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.437127 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:02:06.493402 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.493371 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-openshift-service-ca-bundle\") pod \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " Jul 31 15:02:06.493561 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.493420 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-proxy-tls\") pod \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\" (UID: \"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b\") " Jul 31 15:02:06.493724 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.493698 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" (UID: "824e8e17-9d3b-42be-8ea8-b5f2ced26d8b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:02:06.495666 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.495642 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" (UID: "824e8e17-9d3b-42be-8ea8-b5f2ced26d8b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:02:06.594620 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.594542 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:02:06.594620 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.594571 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:02:06.841549 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.841516 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" Jul 31 15:02:06.841961 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.841556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2" event={"ID":"824e8e17-9d3b-42be-8ea8-b5f2ced26d8b","Type":"ContainerDied","Data":"85bf84d27ea0709b99b087c43469216ca387c70634c661228b0e051fa06877b9"} Jul 31 15:02:06.841961 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.841620 2579 scope.go:117] "RemoveContainer" containerID="abff2f102db47a9ccd5790e0b9e588baef553b1451a2e221a5e6d17fd4759929" Jul 31 15:02:06.864543 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.864514 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2"] Jul 31 15:02:06.869025 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:06.869001 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8c9487985-fvxx2"] Jul 31 15:02:07.043291 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:07.043260 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" path="/var/lib/kubelet/pods/824e8e17-9d3b-42be-8ea8-b5f2ced26d8b/volumes" Jul 31 15:02:36.011598 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.011561 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc"] Jul 31 15:02:36.012185 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.012081 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" Jul 31 15:02:36.012185 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.012136 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" Jul 31 15:02:36.012320 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.012240 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="824e8e17-9d3b-42be-8ea8-b5f2ced26d8b" containerName="model-chainer" Jul 31 15:02:36.015261 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.015241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.017992 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.017966 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a9565-serving-cert\"" Jul 31 15:02:36.018094 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.018014 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a9565-kube-rbac-proxy-sar-config\"" Jul 31 15:02:36.019433 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.019414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:36.025902 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.025879 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc"] Jul 31 15:02:36.033756 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.033736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.033858 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.033777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-openshift-service-ca-bundle\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.134461 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.134436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.134608 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.134473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-openshift-service-ca-bundle\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.134608 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:02:36.134574 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-a9565-serving-cert: secret "sequence-graph-a9565-serving-cert" not found Jul 31 15:02:36.134694 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:02:36.134630 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls podName:5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a nodeName:}" failed. No retries permitted until 2026-07-31 15:02:36.634615562 +0000 UTC m=+878.094228918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls") pod "sequence-graph-a9565-55fcbd5d96-wt9cc" (UID: "5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a") : secret "sequence-graph-a9565-serving-cert" not found Jul 31 15:02:36.135055 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.135039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-openshift-service-ca-bundle\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.637557 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.637527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:36.637758 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:02:36.637640 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-a9565-serving-cert: secret "sequence-graph-a9565-serving-cert" not found Jul 31 15:02:36.637758 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:02:36.637688 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls podName:5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a nodeName:}" failed. No retries permitted until 2026-07-31 15:02:37.637675321 +0000 UTC m=+879.097288676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls") pod "sequence-graph-a9565-55fcbd5d96-wt9cc" (UID: "5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a") : secret "sequence-graph-a9565-serving-cert" not found Jul 31 15:02:36.854385 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:36.854355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:37.644166 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:37.644129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:37.646650 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:37.646632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") pod \"sequence-graph-a9565-55fcbd5d96-wt9cc\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:37.825596 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:37.825572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:37.955898 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:37.955874 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc"] Jul 31 15:02:37.958001 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:02:37.957975 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fbab7b4_19bf_473a_8da2_9e56c2dfaa5a.slice/crio-10423877d9a205825ac87f6a445c69f1f4021c0a7ac0f4dfc44a115fe59dde21 WatchSource:0}: Error finding container 10423877d9a205825ac87f6a445c69f1f4021c0a7ac0f4dfc44a115fe59dde21: Status 404 returned error can't find the container with id 10423877d9a205825ac87f6a445c69f1f4021c0a7ac0f4dfc44a115fe59dde21 Jul 31 15:02:37.996381 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:37.996357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" event={"ID":"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a","Type":"ContainerStarted","Data":"10423877d9a205825ac87f6a445c69f1f4021c0a7ac0f4dfc44a115fe59dde21"} Jul 31 15:02:39.002948 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:39.002909 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" event={"ID":"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a","Type":"ContainerStarted","Data":"244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561"} Jul 31 15:02:39.003414 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:39.003068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:39.023655 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:39.023617 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podStartSLOduration=4.023603359 podStartE2EDuration="4.023603359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:02:39.021580016 +0000 UTC m=+880.481193393" watchObservedRunningTime="2026-07-31 15:02:39.023603359 +0000 UTC m=+880.483216734" Jul 31 15:02:45.013795 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:45.013763 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:02:58.972350 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:58.972277 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:02:58.973544 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:02:58.973522 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:03:50.803591 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:03:50.803554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:50.859621 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:03:50.859591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:05:26.063009 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:05:26.062971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:05:26.116120 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:05:26.116081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:27.653475 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:06:27.653441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:28.725112 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:06:28.725075 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:59.039335 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:06:59.039300 2579 scope.go:117] "RemoveContainer" containerID="a719a2274b1cdc2df960dc80088fb8cb04689f80081fbf605f42304fa0ff6643" Jul 31 15:07:07.673301 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:07.673233 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:41.774771 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:41.774732 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:41.830978 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:41.830928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:43.389196 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:43.389168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:43.489812 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:43.489789 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:59.005114 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:59.005084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:07:59.007275 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:07:59.007256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:09:33.110087 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:33.110045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:54.751076 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:54.751044 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x"] Jul 31 15:09:54.753241 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:54.751237 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" containerID="cri-o://f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14" gracePeriod=30 Jul 31 15:09:54.785462 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:54.785428 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:54.968621 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:54.968590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:55.054524 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:55.054487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:55.402400 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:55.402309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:55.687267 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:55.687181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:57.730313 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:09:57.730273 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:02.729689 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:02.729643 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:07.729756 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:07.729703 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:07.730225 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:07.729831 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:10:12.730025 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:12.729983 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:17.729576 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:17.729517 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:22.729435 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:22.729346 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:24.898749 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:24.898726 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:10:24.965201 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:24.965160 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c0fa4e2-4e21-4960-a822-32532eed1a5c-openshift-service-ca-bundle\") pod \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " Jul 31 15:10:24.965352 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:24.965261 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls\") pod \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\" (UID: \"9c0fa4e2-4e21-4960-a822-32532eed1a5c\") " Jul 31 15:10:24.965498 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:24.965475 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c0fa4e2-4e21-4960-a822-32532eed1a5c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9c0fa4e2-4e21-4960-a822-32532eed1a5c" (UID: "9c0fa4e2-4e21-4960-a822-32532eed1a5c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:10:24.967282 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:24.967259 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9c0fa4e2-4e21-4960-a822-32532eed1a5c" (UID: "9c0fa4e2-4e21-4960-a822-32532eed1a5c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:10:25.066400 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.066377 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c0fa4e2-4e21-4960-a822-32532eed1a5c-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:10:25.066400 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.066399 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c0fa4e2-4e21-4960-a822-32532eed1a5c-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:10:25.105633 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.105598 2579 generic.go:356] "Generic (PLEG): container finished" podID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerID="f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14" exitCode=0 Jul 31 15:10:25.105735 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.105643 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" Jul 31 15:10:25.105735 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.105680 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" event={"ID":"9c0fa4e2-4e21-4960-a822-32532eed1a5c","Type":"ContainerDied","Data":"f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14"} Jul 31 15:10:25.105735 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.105725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x" event={"ID":"9c0fa4e2-4e21-4960-a822-32532eed1a5c","Type":"ContainerDied","Data":"e66a9e2f308cec2d49d84d692d62fb4d684c93b6452ebb7632eb17816eb3f8da"} Jul 31 15:10:25.105874 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.105746 2579 scope.go:117] "RemoveContainer" containerID="f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14" Jul 31 15:10:25.114421 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.114408 2579 scope.go:117] "RemoveContainer" containerID="f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14" Jul 31 15:10:25.114665 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:10:25.114648 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14\": container with ID starting with f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14 not found: ID does not exist" containerID="f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14" Jul 31 15:10:25.114709 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.114675 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14"} err="failed to get container status \"f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14\": rpc error: code = NotFound desc = could not find container \"f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14\": container with ID starting with f8cfa4414bd74880e9c78b24a7ab45821464edf8914799576648448a80dd1f14 not found: ID does not exist" Jul 31 15:10:25.123565 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.123545 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x"] Jul 31 15:10:25.126830 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:25.126810 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7b0b5-5859dbd5c9-v6w2x"] Jul 31 15:10:27.042948 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:27.042897 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" path="/var/lib/kubelet/pods/9c0fa4e2-4e21-4960-a822-32532eed1a5c/volumes" Jul 31 15:10:50.727741 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:50.727706 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc"] Jul 31 15:10:50.728309 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:50.727969 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" containerID="cri-o://244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561" gracePeriod=30 Jul 31 15:10:50.777798 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:50.777771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:50.876645 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:50.876613 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:51.087486 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:51.087447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:51.151647 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:51.151607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:51.251745 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:51.251709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:51.367245 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:51.367165 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:55.011925 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.011886 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:10:55.044561 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.044532 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6"] Jul 31 15:10:55.044885 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.044873 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" Jul 31 15:10:55.044953 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.044887 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" Jul 31 15:10:55.044994 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.044963 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0fa4e2-4e21-4960-a822-32532eed1a5c" containerName="switch-graph-7b0b5" Jul 31 15:10:55.048368 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.048266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.048518 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.048474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:55.050794 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.050777 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-49957-kube-rbac-proxy-sar-config\"" Jul 31 15:10:55.051412 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.051389 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-49957-serving-cert\"" Jul 31 15:10:55.057677 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.057652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6"] Jul 31 15:10:55.204347 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.204318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:55.206271 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.206248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-proxy-tls\") pod \"ensemble-graph-49957-646f5768d6-8lwz6\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.206447 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.206431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-openshift-service-ca-bundle\") pod \"ensemble-graph-49957-646f5768d6-8lwz6\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.307007 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.306981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-openshift-service-ca-bundle\") pod \"ensemble-graph-49957-646f5768d6-8lwz6\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.307123 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.307027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-proxy-tls\") pod \"ensemble-graph-49957-646f5768d6-8lwz6\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.307539 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.307522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-openshift-service-ca-bundle\") pod \"ensemble-graph-49957-646f5768d6-8lwz6\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.309490 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.309473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-proxy-tls\") pod \"ensemble-graph-49957-646f5768d6-8lwz6\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.360685 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.360660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:55.489586 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:55.489554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6"] Jul 31 15:10:55.492627 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:10:55.492605 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa88c76_2edb_4cef_96b8_cb6ec3bcbf3d.slice/crio-26caa145594da0e79f8646f1b646adcb7b9d943f721d29bf23d228a8db4f2a01 WatchSource:0}: Error finding container 26caa145594da0e79f8646f1b646adcb7b9d943f721d29bf23d228a8db4f2a01: Status 404 returned error can't find the container with id 26caa145594da0e79f8646f1b646adcb7b9d943f721d29bf23d228a8db4f2a01 Jul 31 15:10:56.258804 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:56.258764 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" event={"ID":"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d","Type":"ContainerStarted","Data":"fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486"} Jul 31 15:10:56.259290 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:56.258820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" event={"ID":"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d","Type":"ContainerStarted","Data":"26caa145594da0e79f8646f1b646adcb7b9d943f721d29bf23d228a8db4f2a01"} Jul 31 15:10:56.259290 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:56.258850 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:10:56.277561 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:10:56.277518 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podStartSLOduration=1.277502889 podStartE2EDuration="1.277502889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:10:56.275910593 +0000 UTC m=+1377.735523971" watchObservedRunningTime="2026-07-31 15:10:56.277502889 +0000 UTC m=+1377.737116267" Jul 31 15:11:00.011634 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:00.011583 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:02.268957 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:02.268900 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:11:05.012322 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.012213 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:05.012744 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.012356 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:11:05.130109 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.130070 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6"] Jul 31 15:11:05.130302 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.130276 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" containerID="cri-o://fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486" gracePeriod=30 Jul 31 15:11:05.152668 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.152631 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:05.301364 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.301335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:05.389838 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.389788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:05.480139 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.480106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:05.574323 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.574206 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:05.964671 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:05.964552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:07.267684 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:07.267646 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:10.012037 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:10.011994 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:12.267475 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:12.267436 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:15.012621 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:15.012573 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:17.267717 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:17.267682 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:17.268096 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:17.267791 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:11:20.011974 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:20.011912 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:20.874673 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:20.874649 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:11:20.900868 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:20.900845 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-openshift-service-ca-bundle\") pod \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " Jul 31 15:11:20.900988 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:20.900898 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") pod \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\" (UID: \"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a\") " Jul 31 15:11:20.901301 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:20.901275 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" (UID: "5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:11:20.902984 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:20.902960 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" (UID: "5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:11:21.001827 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.001762 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:11:21.001827 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.001787 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:11:21.374454 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.374418 2579 generic.go:356] "Generic (PLEG): container finished" podID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerID="244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561" exitCode=0 Jul 31 15:11:21.374841 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.374470 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" Jul 31 15:11:21.374841 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.374471 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" event={"ID":"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a","Type":"ContainerDied","Data":"244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561"} Jul 31 15:11:21.374841 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.374544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc" event={"ID":"5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a","Type":"ContainerDied","Data":"10423877d9a205825ac87f6a445c69f1f4021c0a7ac0f4dfc44a115fe59dde21"} Jul 31 15:11:21.374841 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.374565 2579 scope.go:117] "RemoveContainer" containerID="244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561" Jul 31 15:11:21.385150 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.385131 2579 scope.go:117] "RemoveContainer" containerID="244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561" Jul 31 15:11:21.385399 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:11:21.385380 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561\": container with ID starting with 244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561 not found: ID does not exist" containerID="244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561" Jul 31 15:11:21.385452 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.385410 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561"} err="failed to get container status \"244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561\": rpc error: code = NotFound desc = could not find container \"244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561\": container with ID starting with 244826f488792b78f564cea206114a9760e9f668bcf336e5db35b5c9deec9561 not found: ID does not exist" Jul 31 15:11:21.392041 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.392021 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc"] Jul 31 15:11:21.395603 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:21.395584 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a9565-55fcbd5d96-wt9cc"] Jul 31 15:11:22.267409 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:22.267374 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:23.043345 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:23.043310 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" path="/var/lib/kubelet/pods/5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a/volumes" Jul 31 15:11:27.267161 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:27.267127 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:32.267420 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:32.267381 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:11:35.285828 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.285800 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:11:35.416574 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.416496 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-proxy-tls\") pod \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " Jul 31 15:11:35.416574 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.416525 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-openshift-service-ca-bundle\") pod \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\" (UID: \"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d\") " Jul 31 15:11:35.416887 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.416864 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" (UID: "0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:11:35.418689 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.418663 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" (UID: "0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:11:35.439353 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.439322 2579 generic.go:356] "Generic (PLEG): container finished" podID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerID="fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486" exitCode=0 Jul 31 15:11:35.439455 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.439368 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" Jul 31 15:11:35.439455 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.439372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" event={"ID":"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d","Type":"ContainerDied","Data":"fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486"} Jul 31 15:11:35.439455 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.439441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6" event={"ID":"0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d","Type":"ContainerDied","Data":"26caa145594da0e79f8646f1b646adcb7b9d943f721d29bf23d228a8db4f2a01"} Jul 31 15:11:35.439580 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.439472 2579 scope.go:117] "RemoveContainer" containerID="fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486" Jul 31 15:11:35.448787 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.448771 2579 scope.go:117] "RemoveContainer" containerID="fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486" Jul 31 15:11:35.449077 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:11:35.449049 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486\": container with ID starting with fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486 not found: ID does not exist" containerID="fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486" Jul 31 15:11:35.449175 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.449087 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486"} err="failed to get container status \"fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486\": rpc error: code = NotFound desc = could not find container \"fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486\": container with ID starting with fc3b1b45d61c5f33fa6bff8eac1c3aaa1e8268078fb69e1c4ca73f7140c22486 not found: ID does not exist" Jul 31 15:11:35.461665 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.461647 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6"] Jul 31 15:11:35.463257 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.463239 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-49957-646f5768d6-8lwz6"] Jul 31 15:11:35.517236 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.517212 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:11:35.517314 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:35.517236 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:11:37.042867 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:11:37.042829 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" path="/var/lib/kubelet/pods/0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d/volumes" Jul 31 15:12:00.959436 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.959395 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh"] Jul 31 15:12:00.959957 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.959911 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" Jul 31 15:12:00.959957 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.959955 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" Jul 31 15:12:00.960102 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.959975 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" Jul 31 15:12:00.960102 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.959983 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" Jul 31 15:12:00.960102 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.960067 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa88c76-2edb-4cef-96b8-cb6ec3bcbf3d" containerName="ensemble-graph-49957" Jul 31 15:12:00.960102 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.960082 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fbab7b4-19bf-473a-8da2-9e56c2dfaa5a" containerName="sequence-graph-a9565" Jul 31 15:12:00.964370 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.964350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:00.967373 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.967352 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a1442-kube-rbac-proxy-sar-config\"" Jul 31 15:12:00.967373 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.967364 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 31 15:12:00.967547 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.967374 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a1442-serving-cert\"" Jul 31 15:12:00.968593 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.968579 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hpn59\"" Jul 31 15:12:00.975299 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.975278 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh"] Jul 31 15:12:00.977674 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:00.977650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:01.119247 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.119208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f465af3a-43ec-4f14-a323-78de0bc11d88-openshift-service-ca-bundle\") pod \"sequence-graph-a1442-9fd45fd4d-bpdzh\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.119247 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.119248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f465af3a-43ec-4f14-a323-78de0bc11d88-proxy-tls\") pod \"sequence-graph-a1442-9fd45fd4d-bpdzh\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.220379 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.220294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f465af3a-43ec-4f14-a323-78de0bc11d88-openshift-service-ca-bundle\") pod \"sequence-graph-a1442-9fd45fd4d-bpdzh\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.220379 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.220332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f465af3a-43ec-4f14-a323-78de0bc11d88-proxy-tls\") pod \"sequence-graph-a1442-9fd45fd4d-bpdzh\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.220905 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.220883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f465af3a-43ec-4f14-a323-78de0bc11d88-openshift-service-ca-bundle\") pod \"sequence-graph-a1442-9fd45fd4d-bpdzh\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.222779 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.222757 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f465af3a-43ec-4f14-a323-78de0bc11d88-proxy-tls\") pod \"sequence-graph-a1442-9fd45fd4d-bpdzh\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.275868 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.275830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.408160 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.408129 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh"] Jul 31 15:12:01.411497 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:12:01.411461 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf465af3a_43ec_4f14_a323_78de0bc11d88.slice/crio-e0952edbf52397e3a83cf829610ba1c3efc4dcb6e981708b9859e7d86a60183e WatchSource:0}: Error finding container e0952edbf52397e3a83cf829610ba1c3efc4dcb6e981708b9859e7d86a60183e: Status 404 returned error can't find the container with id e0952edbf52397e3a83cf829610ba1c3efc4dcb6e981708b9859e7d86a60183e Jul 31 15:12:01.562250 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.562221 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" event={"ID":"f465af3a-43ec-4f14-a323-78de0bc11d88","Type":"ContainerStarted","Data":"0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533"} Jul 31 15:12:01.562420 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.562279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" event={"ID":"f465af3a-43ec-4f14-a323-78de0bc11d88","Type":"ContainerStarted","Data":"e0952edbf52397e3a83cf829610ba1c3efc4dcb6e981708b9859e7d86a60183e"} Jul 31 15:12:01.562420 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.562306 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:01.581328 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:01.581283 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podStartSLOduration=1.581268965 podStartE2EDuration="1.581268965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:12:01.580136518 +0000 UTC m=+1443.039749921" watchObservedRunningTime="2026-07-31 15:12:01.581268965 +0000 UTC m=+1443.040882342" Jul 31 15:12:03.008629 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:03.008596 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:05.369588 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.369552 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c"] Jul 31 15:12:05.373248 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.373225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.375971 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.375928 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-06a6c-serving-cert\"" Jul 31 15:12:05.376076 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.375927 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-06a6c-kube-rbac-proxy-sar-config\"" Jul 31 15:12:05.381598 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.381576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c"] Jul 31 15:12:05.384530 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.384505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:05.453376 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.453346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d823ad5c-3459-4a8e-857d-72d68773b2bc-proxy-tls\") pod \"ensemble-graph-06a6c-784596677c-tv66c\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.453503 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.453434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d823ad5c-3459-4a8e-857d-72d68773b2bc-openshift-service-ca-bundle\") pod \"ensemble-graph-06a6c-784596677c-tv66c\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.532588 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.532559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:05.554530 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.554508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d823ad5c-3459-4a8e-857d-72d68773b2bc-proxy-tls\") pod \"ensemble-graph-06a6c-784596677c-tv66c\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.554607 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.554556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d823ad5c-3459-4a8e-857d-72d68773b2bc-openshift-service-ca-bundle\") pod \"ensemble-graph-06a6c-784596677c-tv66c\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.555118 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.555097 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d823ad5c-3459-4a8e-857d-72d68773b2bc-openshift-service-ca-bundle\") pod \"ensemble-graph-06a6c-784596677c-tv66c\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.557035 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.557012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d823ad5c-3459-4a8e-857d-72d68773b2bc-proxy-tls\") pod \"ensemble-graph-06a6c-784596677c-tv66c\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.686219 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.686167 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:05.813881 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:05.813854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c"] Jul 31 15:12:05.815893 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:12:05.815870 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd823ad5c_3459_4a8e_857d_72d68773b2bc.slice/crio-c369144783f847556ef7713871cb05e67a93e9d87a3f3fbd80ea3bc57232773c WatchSource:0}: Error finding container c369144783f847556ef7713871cb05e67a93e9d87a3f3fbd80ea3bc57232773c: Status 404 returned error can't find the container with id c369144783f847556ef7713871cb05e67a93e9d87a3f3fbd80ea3bc57232773c Jul 31 15:12:06.586452 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:06.586422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" event={"ID":"d823ad5c-3459-4a8e-857d-72d68773b2bc","Type":"ContainerStarted","Data":"d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce"} Jul 31 15:12:06.586913 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:06.586468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" event={"ID":"d823ad5c-3459-4a8e-857d-72d68773b2bc","Type":"ContainerStarted","Data":"c369144783f847556ef7713871cb05e67a93e9d87a3f3fbd80ea3bc57232773c"} Jul 31 15:12:06.586913 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:06.586526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:06.605419 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:06.605374 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podStartSLOduration=1.605360721 podStartE2EDuration="1.605360721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:12:06.603616046 +0000 UTC m=+1448.063229426" watchObservedRunningTime="2026-07-31 15:12:06.605360721 +0000 UTC m=+1448.064974099" Jul 31 15:12:07.574312 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:07.574283 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:12.597921 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:12.597896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:12:15.061652 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:15.061617 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh"] Jul 31 15:12:15.062128 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:15.061852 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" containerID="cri-o://0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533" gracePeriod=30 Jul 31 15:12:15.428911 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:15.428828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:15.521759 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:15.521717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:15.622987 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:15.622956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:15.830813 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:15.830777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:12:17.571889 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:17.571847 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:12:22.571621 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:22.571576 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:12:27.571370 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:27.571320 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:12:27.571758 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:27.571442 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:32.571054 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:32.571018 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:12:37.571522 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:37.571487 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:12:42.572168 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:42.572126 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:12:45.262102 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.262080 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:45.360400 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.360340 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f465af3a-43ec-4f14-a323-78de0bc11d88-proxy-tls\") pod \"f465af3a-43ec-4f14-a323-78de0bc11d88\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " Jul 31 15:12:45.360509 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.360410 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f465af3a-43ec-4f14-a323-78de0bc11d88-openshift-service-ca-bundle\") pod \"f465af3a-43ec-4f14-a323-78de0bc11d88\" (UID: \"f465af3a-43ec-4f14-a323-78de0bc11d88\") " Jul 31 15:12:45.360775 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.360747 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f465af3a-43ec-4f14-a323-78de0bc11d88-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f465af3a-43ec-4f14-a323-78de0bc11d88" (UID: "f465af3a-43ec-4f14-a323-78de0bc11d88"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:12:45.362390 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.362369 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f465af3a-43ec-4f14-a323-78de0bc11d88-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f465af3a-43ec-4f14-a323-78de0bc11d88" (UID: "f465af3a-43ec-4f14-a323-78de0bc11d88"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:12:45.461804 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.461777 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f465af3a-43ec-4f14-a323-78de0bc11d88-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:12:45.461804 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.461800 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f465af3a-43ec-4f14-a323-78de0bc11d88-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:12:45.765436 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.765333 2579 generic.go:356] "Generic (PLEG): container finished" podID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerID="0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533" exitCode=0 Jul 31 15:12:45.765436 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.765386 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" Jul 31 15:12:45.765436 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.765419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" event={"ID":"f465af3a-43ec-4f14-a323-78de0bc11d88","Type":"ContainerDied","Data":"0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533"} Jul 31 15:12:45.765689 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.765475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh" event={"ID":"f465af3a-43ec-4f14-a323-78de0bc11d88","Type":"ContainerDied","Data":"e0952edbf52397e3a83cf829610ba1c3efc4dcb6e981708b9859e7d86a60183e"} Jul 31 15:12:45.765689 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.765498 2579 scope.go:117] "RemoveContainer" containerID="0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533" Jul 31 15:12:45.774464 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.774446 2579 scope.go:117] "RemoveContainer" containerID="0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533" Jul 31 15:12:45.774710 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:12:45.774692 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533\": container with ID starting with 0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533 not found: ID does not exist" containerID="0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533" Jul 31 15:12:45.774759 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.774720 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533"} err="failed to get container status \"0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533\": rpc error: code = NotFound desc = could not find container \"0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533\": container with ID starting with 0457080469faf07f47002f7358530a747647bdb490901627d8d023061af09533 not found: ID does not exist" Jul 31 15:12:45.786163 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.786139 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh"] Jul 31 15:12:45.790295 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:45.790276 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a1442-9fd45fd4d-bpdzh"] Jul 31 15:12:47.043009 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:47.042972 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" path="/var/lib/kubelet/pods/f465af3a-43ec-4f14-a323-78de0bc11d88/volumes" Jul 31 15:12:59.030814 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:59.030782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:12:59.035078 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:12:59.035059 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:13:15.372265 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.372228 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46"] Jul 31 15:13:15.372842 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.372787 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" Jul 31 15:13:15.372842 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.372807 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" Jul 31 15:13:15.372984 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.372958 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f465af3a-43ec-4f14-a323-78de0bc11d88" containerName="sequence-graph-a1442" Jul 31 15:13:15.377314 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.377291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:15.381500 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.381477 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-7b982-serving-cert\"" Jul 31 15:13:15.381500 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.381495 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-7b982-kube-rbac-proxy-sar-config\"" Jul 31 15:13:15.388676 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.388649 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46"] Jul 31 15:13:15.400762 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.400733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-openshift-service-ca-bundle\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:15.400867 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.400802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:15.502027 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.502000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-openshift-service-ca-bundle\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:15.502160 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.502050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:15.502226 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:13:15.502169 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-7b982-serving-cert: secret "sequence-graph-7b982-serving-cert" not found Jul 31 15:13:15.502284 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:13:15.502235 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls podName:32ea8c9d-a07d-49f0-87eb-2986ea2dea94 nodeName:}" failed. No retries permitted until 2026-07-31 15:13:16.002214753 +0000 UTC m=+1517.461828123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls") pod "sequence-graph-7b982-6788699d75-lth46" (UID: "32ea8c9d-a07d-49f0-87eb-2986ea2dea94") : secret "sequence-graph-7b982-serving-cert" not found Jul 31 15:13:15.502572 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:15.502550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-openshift-service-ca-bundle\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:16.006297 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.006267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:16.008733 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.008703 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls\") pod \"sequence-graph-7b982-6788699d75-lth46\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:16.288666 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.288640 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:16.417015 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.416991 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46"] Jul 31 15:13:16.419073 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:13:16.419048 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ea8c9d_a07d_49f0_87eb_2986ea2dea94.slice/crio-77f84e759ecc2751124b36639e4f7363801084a8f6a4bca0d1318361c19fbbc1 WatchSource:0}: Error finding container 77f84e759ecc2751124b36639e4f7363801084a8f6a4bca0d1318361c19fbbc1: Status 404 returned error can't find the container with id 77f84e759ecc2751124b36639e4f7363801084a8f6a4bca0d1318361c19fbbc1 Jul 31 15:13:16.914557 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.914519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" event={"ID":"32ea8c9d-a07d-49f0-87eb-2986ea2dea94","Type":"ContainerStarted","Data":"9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664"} Jul 31 15:13:16.914702 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.914575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" event={"ID":"32ea8c9d-a07d-49f0-87eb-2986ea2dea94","Type":"ContainerStarted","Data":"77f84e759ecc2751124b36639e4f7363801084a8f6a4bca0d1318361c19fbbc1"} Jul 31 15:13:16.914702 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.914609 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:13:16.933985 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:16.933921 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podStartSLOduration=1.933905743 podStartE2EDuration="1.933905743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:13:16.932739946 +0000 UTC m=+1518.392353325" watchObservedRunningTime="2026-07-31 15:13:16.933905743 +0000 UTC m=+1518.393519121" Jul 31 15:13:17.453877 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:17.453842 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:17.553970 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:17.553918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:22.924738 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:13:22.924703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:17:53.018676 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:17:53.018569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:59.065121 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:17:59.065086 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:17:59.068884 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:17:59.068861 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:20:20.017381 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.017350 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c"] Jul 31 15:20:20.020030 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.017701 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" containerID="cri-o://d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce" gracePeriod=30 Jul 31 15:20:20.078323 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.078292 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:20.182620 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.182587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:20.268722 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.268647 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:20.362918 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.362888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:20.428271 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.428237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:20.677575 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:20.677545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:22.596032 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:22.595984 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:20:27.595858 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:27.595814 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:20:32.595880 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:32.595843 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:20:32.596369 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:32.595958 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:20:37.596462 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:37.596418 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:20:42.595958 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:42.595892 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:20:47.595576 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:47.595529 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:20:50.171801 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.171776 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:20:50.319191 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.319161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d823ad5c-3459-4a8e-857d-72d68773b2bc-openshift-service-ca-bundle\") pod \"d823ad5c-3459-4a8e-857d-72d68773b2bc\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " Jul 31 15:20:50.319394 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.319218 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d823ad5c-3459-4a8e-857d-72d68773b2bc-proxy-tls\") pod \"d823ad5c-3459-4a8e-857d-72d68773b2bc\" (UID: \"d823ad5c-3459-4a8e-857d-72d68773b2bc\") " Jul 31 15:20:50.319530 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.319507 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d823ad5c-3459-4a8e-857d-72d68773b2bc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d823ad5c-3459-4a8e-857d-72d68773b2bc" (UID: "d823ad5c-3459-4a8e-857d-72d68773b2bc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:20:50.321439 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.321421 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d823ad5c-3459-4a8e-857d-72d68773b2bc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d823ad5c-3459-4a8e-857d-72d68773b2bc" (UID: "d823ad5c-3459-4a8e-857d-72d68773b2bc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:20:50.420473 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.420447 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d823ad5c-3459-4a8e-857d-72d68773b2bc-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:20:50.420473 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:50.420469 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d823ad5c-3459-4a8e-857d-72d68773b2bc-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:20:51.001263 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.001221 2579 generic.go:356] "Generic (PLEG): container finished" podID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerID="d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce" exitCode=0 Jul 31 15:20:51.001480 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.001277 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" Jul 31 15:20:51.001480 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.001312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" event={"ID":"d823ad5c-3459-4a8e-857d-72d68773b2bc","Type":"ContainerDied","Data":"d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce"} Jul 31 15:20:51.001480 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.001387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c" event={"ID":"d823ad5c-3459-4a8e-857d-72d68773b2bc","Type":"ContainerDied","Data":"c369144783f847556ef7713871cb05e67a93e9d87a3f3fbd80ea3bc57232773c"} Jul 31 15:20:51.001480 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.001423 2579 scope.go:117] "RemoveContainer" containerID="d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce" Jul 31 15:20:51.011771 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.011750 2579 scope.go:117] "RemoveContainer" containerID="d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce" Jul 31 15:20:51.012116 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:20:51.012096 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce\": container with ID starting with d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce not found: ID does not exist" containerID="d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce" Jul 31 15:20:51.012203 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.012124 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce"} err="failed to get container status \"d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce\": rpc error: code = NotFound desc = could not find container \"d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce\": container with ID starting with d1ed437c473f386d00799dceebf55ff38065969effedd628ce610d3c114c19ce not found: ID does not exist" Jul 31 15:20:51.024402 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.024333 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c"] Jul 31 15:20:51.026795 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.026762 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-06a6c-784596677c-tv66c"] Jul 31 15:20:51.043135 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:20:51.043113 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" path="/var/lib/kubelet/pods/d823ad5c-3459-4a8e-857d-72d68773b2bc/volumes" Jul 31 15:21:20.313126 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.313092 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft"] Jul 31 15:21:20.313571 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.313451 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" Jul 31 15:21:20.313571 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.313463 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" Jul 31 15:21:20.313571 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.313519 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d823ad5c-3459-4a8e-857d-72d68773b2bc" containerName="ensemble-graph-06a6c" Jul 31 15:21:20.316648 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.316621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:20.319398 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.319371 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-e31d5-serving-cert\"" Jul 31 15:21:20.319586 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.319567 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-e31d5-kube-rbac-proxy-sar-config\"" Jul 31 15:21:20.320143 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.320117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:20.329523 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.329503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft"] Jul 31 15:21:20.458003 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.457967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c018439e-ceb9-43e5-9f50-48e4b0a195e6-openshift-service-ca-bundle\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:20.458003 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.458007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:20.558389 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.558364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c018439e-ceb9-43e5-9f50-48e4b0a195e6-openshift-service-ca-bundle\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:20.558506 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.558393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:20.558506 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:21:20.558501 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-e31d5-serving-cert: secret "splitter-graph-e31d5-serving-cert" not found Jul 31 15:21:20.558590 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:21:20.558562 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls podName:c018439e-ceb9-43e5-9f50-48e4b0a195e6 nodeName:}" failed. No retries permitted until 2026-07-31 15:21:21.058543157 +0000 UTC m=+2002.518156515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls") pod "splitter-graph-e31d5-564c58485c-xhmft" (UID: "c018439e-ceb9-43e5-9f50-48e4b0a195e6") : secret "splitter-graph-e31d5-serving-cert" not found Jul 31 15:21:20.559176 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.559158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c018439e-ceb9-43e5-9f50-48e4b0a195e6-openshift-service-ca-bundle\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:20.638226 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:20.638149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:21.062281 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:21.062255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:21.064676 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:21.064654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls\") pod \"splitter-graph-e31d5-564c58485c-xhmft\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:21.227810 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:21.227785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:21.360872 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:21.360847 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft"] Jul 31 15:21:21.363328 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:21:21.363291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc018439e_ceb9_43e5_9f50_48e4b0a195e6.slice/crio-d8babc1225e3800dbb6c064cb79d804af16a5f68e063a8b840c307d8d065f88e WatchSource:0}: Error finding container d8babc1225e3800dbb6c064cb79d804af16a5f68e063a8b840c307d8d065f88e: Status 404 returned error can't find the container with id d8babc1225e3800dbb6c064cb79d804af16a5f68e063a8b840c307d8d065f88e Jul 31 15:21:22.139023 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:22.138987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" event={"ID":"c018439e-ceb9-43e5-9f50-48e4b0a195e6","Type":"ContainerStarted","Data":"b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2"} Jul 31 15:21:22.139212 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:22.139040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" event={"ID":"c018439e-ceb9-43e5-9f50-48e4b0a195e6","Type":"ContainerStarted","Data":"d8babc1225e3800dbb6c064cb79d804af16a5f68e063a8b840c307d8d065f88e"} Jul 31 15:21:22.139212 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:22.139126 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:22.157547 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:22.157497 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podStartSLOduration=2.1574831899999998 podStartE2EDuration="2.15748319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:21:22.155904596 +0000 UTC m=+2003.615517976" watchObservedRunningTime="2026-07-31 15:21:22.15748319 +0000 UTC m=+2003.617096619" Jul 31 15:21:28.149336 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:28.149309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:30.039641 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.039608 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46"] Jul 31 15:21:30.040015 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.039790 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" containerID="cri-o://9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664" gracePeriod=30 Jul 31 15:21:30.061007 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.060982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:30.309722 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.309692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:30.425022 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.424989 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft"] Jul 31 15:21:30.425281 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.425225 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" containerID="cri-o://b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2" gracePeriod=30 Jul 31 15:21:30.438671 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.438641 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:30.544755 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.544728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:30.643262 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:30.643192 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:31.057974 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:31.057922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:31.148163 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:31.148131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:31.249678 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:31.249644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:31.416288 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:31.416196 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:32.923026 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:32.922981 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:33.148323 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:33.148290 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:37.922828 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:37.922780 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:38.148132 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:38.148091 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:42.922524 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:42.922483 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:42.923008 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:42.922608 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:21:43.148970 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:43.148920 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:43.149170 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:43.149035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:21:47.922848 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:47.922804 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:48.147660 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:48.147621 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:52.923441 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:52.923385 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:53.148290 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:53.148251 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:57.923253 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:57.923214 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:21:58.148092 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:21:58.148049 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:22:00.208347 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.208323 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:22:00.274496 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.274468 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-openshift-service-ca-bundle\") pod \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " Jul 31 15:22:00.274624 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.274515 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls\") pod \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\" (UID: \"32ea8c9d-a07d-49f0-87eb-2986ea2dea94\") " Jul 31 15:22:00.274808 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.274783 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "32ea8c9d-a07d-49f0-87eb-2986ea2dea94" (UID: "32ea8c9d-a07d-49f0-87eb-2986ea2dea94"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:22:00.276631 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.276611 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "32ea8c9d-a07d-49f0-87eb-2986ea2dea94" (UID: "32ea8c9d-a07d-49f0-87eb-2986ea2dea94"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:22:00.307725 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.307659 2579 generic.go:356] "Generic (PLEG): container finished" podID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerID="9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664" exitCode=0 Jul 31 15:22:00.307725 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.307703 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" Jul 31 15:22:00.307859 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.307736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" event={"ID":"32ea8c9d-a07d-49f0-87eb-2986ea2dea94","Type":"ContainerDied","Data":"9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664"} Jul 31 15:22:00.307859 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.307784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46" event={"ID":"32ea8c9d-a07d-49f0-87eb-2986ea2dea94","Type":"ContainerDied","Data":"77f84e759ecc2751124b36639e4f7363801084a8f6a4bca0d1318361c19fbbc1"} Jul 31 15:22:00.307859 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.307808 2579 scope.go:117] "RemoveContainer" containerID="9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664" Jul 31 15:22:00.316879 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.316864 2579 scope.go:117] "RemoveContainer" containerID="9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664" Jul 31 15:22:00.317152 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:22:00.317135 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664\": container with ID starting with 9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664 not found: ID does not exist" containerID="9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664" Jul 31 15:22:00.317223 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.317159 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664"} err="failed to get container status \"9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664\": rpc error: code = NotFound desc = could not find container \"9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664\": container with ID starting with 9c6f070154fc1635db98ba9dfe76755ce8104208f9f67c54cca729628ef0c664 not found: ID does not exist" Jul 31 15:22:00.335165 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.335140 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46"] Jul 31 15:22:00.342840 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.342821 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7b982-6788699d75-lth46"] Jul 31 15:22:00.375098 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.375073 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:22:00.375098 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.375095 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32ea8c9d-a07d-49f0-87eb-2986ea2dea94-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:22:00.601384 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.601360 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:22:00.677460 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.677433 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls\") pod \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " Jul 31 15:22:00.677610 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.677495 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c018439e-ceb9-43e5-9f50-48e4b0a195e6-openshift-service-ca-bundle\") pod \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\" (UID: \"c018439e-ceb9-43e5-9f50-48e4b0a195e6\") " Jul 31 15:22:00.677849 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.677826 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c018439e-ceb9-43e5-9f50-48e4b0a195e6-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c018439e-ceb9-43e5-9f50-48e4b0a195e6" (UID: "c018439e-ceb9-43e5-9f50-48e4b0a195e6"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:22:00.679551 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.679531 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c018439e-ceb9-43e5-9f50-48e4b0a195e6" (UID: "c018439e-ceb9-43e5-9f50-48e4b0a195e6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:22:00.778025 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.777996 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c018439e-ceb9-43e5-9f50-48e4b0a195e6-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:22:00.778025 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:00.778021 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c018439e-ceb9-43e5-9f50-48e4b0a195e6-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:22:01.043670 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.043640 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" path="/var/lib/kubelet/pods/32ea8c9d-a07d-49f0-87eb-2986ea2dea94/volumes" Jul 31 15:22:01.313394 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.313302 2579 generic.go:356] "Generic (PLEG): container finished" podID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerID="b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2" exitCode=137 Jul 31 15:22:01.313394 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.313347 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" Jul 31 15:22:01.313900 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.313395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" event={"ID":"c018439e-ceb9-43e5-9f50-48e4b0a195e6","Type":"ContainerDied","Data":"b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2"} Jul 31 15:22:01.313900 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.313460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft" event={"ID":"c018439e-ceb9-43e5-9f50-48e4b0a195e6","Type":"ContainerDied","Data":"d8babc1225e3800dbb6c064cb79d804af16a5f68e063a8b840c307d8d065f88e"} Jul 31 15:22:01.313900 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.313475 2579 scope.go:117] "RemoveContainer" containerID="b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2" Jul 31 15:22:01.322212 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.322195 2579 scope.go:117] "RemoveContainer" containerID="b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2" Jul 31 15:22:01.322484 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:22:01.322462 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2\": container with ID starting with b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2 not found: ID does not exist" containerID="b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2" Jul 31 15:22:01.322571 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.322494 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2"} err="failed to get container status \"b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2\": rpc error: code = NotFound desc = could not find container \"b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2\": container with ID starting with b20b619b1fbcad453af2f32336216d47fd22add159bffc3e54b8a5409ea97db2 not found: ID does not exist" Jul 31 15:22:01.340802 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.340779 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft"] Jul 31 15:22:01.344380 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:01.344362 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e31d5-564c58485c-xhmft"] Jul 31 15:22:03.043729 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:03.043679 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" path="/var/lib/kubelet/pods/c018439e-ceb9-43e5-9f50-48e4b0a195e6/volumes" Jul 31 15:22:30.387013 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.386981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9"] Jul 31 15:22:30.387404 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.387314 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" Jul 31 15:22:30.387404 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.387325 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" Jul 31 15:22:30.387404 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.387335 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" Jul 31 15:22:30.387404 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.387341 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" Jul 31 15:22:30.387404 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.387395 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ea8c9d-a07d-49f0-87eb-2986ea2dea94" containerName="sequence-graph-7b982" Jul 31 15:22:30.387404 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.387405 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c018439e-ceb9-43e5-9f50-48e4b0a195e6" containerName="splitter-graph-e31d5" Jul 31 15:22:30.391683 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.391665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:30.395852 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.395829 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7902a-serving-cert\"" Jul 31 15:22:30.396060 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.396046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hpn59\"" Jul 31 15:22:30.398792 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.398771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7902a-kube-rbac-proxy-sar-config\"" Jul 31 15:22:30.398914 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.398769 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 31 15:22:30.413286 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.413255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9"] Jul 31 15:22:30.413611 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.413588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa3fa5e-7cc6-4899-b142-98706019b01e-openshift-service-ca-bundle\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:30.413716 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.413697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:30.417468 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.417446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:30.515198 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.515103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:30.515198 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:22:30.515183 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-7902a-serving-cert: secret "switch-graph-7902a-serving-cert" not found Jul 31 15:22:30.515422 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.515251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa3fa5e-7cc6-4899-b142-98706019b01e-openshift-service-ca-bundle\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:30.515422 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:22:30.515346 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls podName:baa3fa5e-7cc6-4899-b142-98706019b01e nodeName:}" failed. No retries permitted until 2026-07-31 15:22:31.015328037 +0000 UTC m=+2072.474941392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls") pod "switch-graph-7902a-75876bd9fb-dtnk9" (UID: "baa3fa5e-7cc6-4899-b142-98706019b01e") : secret "switch-graph-7902a-serving-cert" not found Jul 31 15:22:30.515819 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.515798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa3fa5e-7cc6-4899-b142-98706019b01e-openshift-service-ca-bundle\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:30.940055 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:30.940018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:31.019756 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:31.019725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:31.022375 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:31.022348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls\") pod \"switch-graph-7902a-75876bd9fb-dtnk9\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:31.303036 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:31.303007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:31.461137 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:31.461107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9"] Jul 31 15:22:31.464289 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:22:31.464258 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa3fa5e_7cc6_4899_b142_98706019b01e.slice/crio-9685b51f784555eddc4b73174d82779f9b169d0f0553b26cf92c6af2508d684c WatchSource:0}: Error finding container 9685b51f784555eddc4b73174d82779f9b169d0f0553b26cf92c6af2508d684c: Status 404 returned error can't find the container with id 9685b51f784555eddc4b73174d82779f9b169d0f0553b26cf92c6af2508d684c Jul 31 15:22:32.456535 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:32.456500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" event={"ID":"baa3fa5e-7cc6-4899-b142-98706019b01e","Type":"ContainerStarted","Data":"17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c"} Jul 31 15:22:32.456745 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:32.456557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" event={"ID":"baa3fa5e-7cc6-4899-b142-98706019b01e","Type":"ContainerStarted","Data":"9685b51f784555eddc4b73174d82779f9b169d0f0553b26cf92c6af2508d684c"} Jul 31 15:22:32.456745 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:32.456647 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:35.784434 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:35.784403 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:35.871206 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:35.871178 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:38.467692 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:38.467659 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:22:38.487519 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:38.487468 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podStartSLOduration=8.487454064 podStartE2EDuration="8.487454064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:22:32.486237632 +0000 UTC m=+2073.945851009" watchObservedRunningTime="2026-07-31 15:22:38.487454064 +0000 UTC m=+2079.947067463" Jul 31 15:22:40.707196 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.707162 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk"] Jul 31 15:22:40.708711 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.708688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:40.711353 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.711337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:40.714080 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.714057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-faf8d-kube-rbac-proxy-sar-config\"" Jul 31 15:22:40.714723 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.714711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-faf8d-serving-cert\"" Jul 31 15:22:40.722337 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.722297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk"] Jul 31 15:22:40.793976 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.793955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adaf092f-278d-4453-88df-4af746f15dee-openshift-service-ca-bundle\") pod \"splitter-graph-faf8d-7794748f4c-g24jk\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:40.794089 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.794003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adaf092f-278d-4453-88df-4af746f15dee-proxy-tls\") pod \"splitter-graph-faf8d-7794748f4c-g24jk\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:40.842001 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.841977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:40.894584 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.894555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adaf092f-278d-4453-88df-4af746f15dee-proxy-tls\") pod \"splitter-graph-faf8d-7794748f4c-g24jk\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:40.894706 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.894613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adaf092f-278d-4453-88df-4af746f15dee-openshift-service-ca-bundle\") pod \"splitter-graph-faf8d-7794748f4c-g24jk\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:40.895232 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.895207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adaf092f-278d-4453-88df-4af746f15dee-openshift-service-ca-bundle\") pod \"splitter-graph-faf8d-7794748f4c-g24jk\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:40.897267 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:40.897249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adaf092f-278d-4453-88df-4af746f15dee-proxy-tls\") pod \"splitter-graph-faf8d-7794748f4c-g24jk\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:41.021625 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:41.021552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:41.156419 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:41.156395 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk"] Jul 31 15:22:41.158530 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:22:41.158500 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadaf092f_278d_4453_88df_4af746f15dee.slice/crio-8acf3b2f44668e48697111ee69d9f6070cd53a7c90b3203bca0349c898dbdbce WatchSource:0}: Error finding container 8acf3b2f44668e48697111ee69d9f6070cd53a7c90b3203bca0349c898dbdbce: Status 404 returned error can't find the container with id 8acf3b2f44668e48697111ee69d9f6070cd53a7c90b3203bca0349c898dbdbce Jul 31 15:22:41.499621 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:41.499587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" event={"ID":"adaf092f-278d-4453-88df-4af746f15dee","Type":"ContainerStarted","Data":"29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5"} Jul 31 15:22:41.499792 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:41.499642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" event={"ID":"adaf092f-278d-4453-88df-4af746f15dee","Type":"ContainerStarted","Data":"8acf3b2f44668e48697111ee69d9f6070cd53a7c90b3203bca0349c898dbdbce"} Jul 31 15:22:41.499792 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:41.499674 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:41.519421 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:41.519379 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podStartSLOduration=1.519367167 podStartE2EDuration="1.519367167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:22:41.517546544 +0000 UTC m=+2082.977159921" watchObservedRunningTime="2026-07-31 15:22:41.519367167 +0000 UTC m=+2082.978980545" Jul 31 15:22:47.509606 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:47.509570 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:22:59.094163 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:59.094135 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:22:59.098311 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:22:59.098290 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:23:54.861457 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:23:54.861368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:27:32.403052 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:27:32.403017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:27:59.128869 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:27:59.128835 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:27:59.133693 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:27:59.133658 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:30:55.338062 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:30:55.338031 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk"] Jul 31 15:30:55.338671 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:30:55.338227 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" containerID="cri-o://29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5" gracePeriod=30 Jul 31 15:30:55.397297 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:30:55.397249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:30:57.507549 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:30:57.507508 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:30:58.322796 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:30:58.322762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:02.507898 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:02.507853 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:31:07.507668 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:07.507629 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:31:07.508071 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:07.507738 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:31:12.508002 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:12.507959 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:31:17.507305 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:17.507265 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:31:22.507526 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:22.507442 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:31:25.488095 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.488072 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:31:25.567398 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.567372 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adaf092f-278d-4453-88df-4af746f15dee-openshift-service-ca-bundle\") pod \"adaf092f-278d-4453-88df-4af746f15dee\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " Jul 31 15:31:25.567398 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.567402 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adaf092f-278d-4453-88df-4af746f15dee-proxy-tls\") pod \"adaf092f-278d-4453-88df-4af746f15dee\" (UID: \"adaf092f-278d-4453-88df-4af746f15dee\") " Jul 31 15:31:25.567723 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.567692 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adaf092f-278d-4453-88df-4af746f15dee-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "adaf092f-278d-4453-88df-4af746f15dee" (UID: "adaf092f-278d-4453-88df-4af746f15dee"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:31:25.569569 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.569544 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adaf092f-278d-4453-88df-4af746f15dee-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "adaf092f-278d-4453-88df-4af746f15dee" (UID: "adaf092f-278d-4453-88df-4af746f15dee"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:31:25.668896 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.668804 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adaf092f-278d-4453-88df-4af746f15dee-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:31:25.668896 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.668844 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adaf092f-278d-4453-88df-4af746f15dee-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:31:25.883168 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.883128 2579 generic.go:356] "Generic (PLEG): container finished" podID="adaf092f-278d-4453-88df-4af746f15dee" containerID="29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5" exitCode=0 Jul 31 15:31:25.883322 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.883176 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" Jul 31 15:31:25.883322 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.883181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" event={"ID":"adaf092f-278d-4453-88df-4af746f15dee","Type":"ContainerDied","Data":"29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5"} Jul 31 15:31:25.883322 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.883236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk" event={"ID":"adaf092f-278d-4453-88df-4af746f15dee","Type":"ContainerDied","Data":"8acf3b2f44668e48697111ee69d9f6070cd53a7c90b3203bca0349c898dbdbce"} Jul 31 15:31:25.883322 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.883266 2579 scope.go:117] "RemoveContainer" containerID="29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5" Jul 31 15:31:25.892689 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.892671 2579 scope.go:117] "RemoveContainer" containerID="29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5" Jul 31 15:31:25.893006 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:31:25.892984 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5\": container with ID starting with 29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5 not found: ID does not exist" containerID="29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5" Jul 31 15:31:25.893105 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.893011 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5"} err="failed to get container status \"29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5\": rpc error: code = NotFound desc = could not find container \"29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5\": container with ID starting with 29f75c2e2f87f5f73f4485f531baaf0749dc92f3546b9d317e6e31b4dd2988a5 not found: ID does not exist" Jul 31 15:31:25.924748 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.924696 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk"] Jul 31 15:31:25.932712 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:25.932687 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-faf8d-7794748f4c-g24jk"] Jul 31 15:31:27.042666 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:31:27.042637 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adaf092f-278d-4453-88df-4af746f15dee" path="/var/lib/kubelet/pods/adaf092f-278d-4453-88df-4af746f15dee/volumes" Jul 31 15:32:06.193869 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:32:06.193826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:59.155989 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:32:59.155903 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:32:59.161718 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:32:59.161696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:37:21.467618 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:37:21.467537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:59.185740 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:37:59.185716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:37:59.192360 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:37:59.192338 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:38:49.653509 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:49.653421 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9"] Jul 31 15:38:49.654056 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:49.653654 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" containerID="cri-o://17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c" gracePeriod=30 Jul 31 15:38:49.687729 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:49.687706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:49.829951 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:49.829892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:49.893176 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:49.893145 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:51.357062 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:51.357032 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:51.452961 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:51.452897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:53.466130 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:53.466097 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:38:58.465776 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:38:58.465740 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:39:03.465999 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:03.465953 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:39:03.466372 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:03.466077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:39:07.157638 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:07.157610 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:07.994737 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:07.994704 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:08.465851 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:08.465820 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:39:08.838202 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:08.838180 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:09.668240 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:09.668198 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:10.618358 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:10.618329 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:11.497096 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:11.497062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:12.389528 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:12.389505 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:13.255639 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:13.255607 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:13.465439 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:13.465404 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:39:14.196415 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:14.196382 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:15.152910 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:15.152868 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:16.104283 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:16.104255 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:17.061693 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:17.061662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:18.265442 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:18.265410 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:18.466110 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:18.466078 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 15:39:19.160923 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.160891 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-7902a-75876bd9fb-dtnk9_baa3fa5e-7cc6-4899-b142-98706019b01e/switch-graph-7902a/0.log" Jul 31 15:39:19.803675 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.803653 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:39:19.847341 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.847316 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls\") pod \"baa3fa5e-7cc6-4899-b142-98706019b01e\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " Jul 31 15:39:19.847458 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.847362 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa3fa5e-7cc6-4899-b142-98706019b01e-openshift-service-ca-bundle\") pod \"baa3fa5e-7cc6-4899-b142-98706019b01e\" (UID: \"baa3fa5e-7cc6-4899-b142-98706019b01e\") " Jul 31 15:39:19.847806 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.847780 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa3fa5e-7cc6-4899-b142-98706019b01e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "baa3fa5e-7cc6-4899-b142-98706019b01e" (UID: "baa3fa5e-7cc6-4899-b142-98706019b01e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:39:19.849367 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.849345 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "baa3fa5e-7cc6-4899-b142-98706019b01e" (UID: "baa3fa5e-7cc6-4899-b142-98706019b01e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:39:19.948111 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.948050 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa3fa5e-7cc6-4899-b142-98706019b01e-proxy-tls\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:39:19.948111 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:19.948074 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa3fa5e-7cc6-4899-b142-98706019b01e-openshift-service-ca-bundle\") on node \"ip-10-0-136-197.ec2.internal\" DevicePath \"\"" Jul 31 15:39:20.041830 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.041796 2579 generic.go:356] "Generic (PLEG): container finished" podID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerID="17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c" exitCode=0 Jul 31 15:39:20.041989 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.041834 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" Jul 31 15:39:20.041989 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.041862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" event={"ID":"baa3fa5e-7cc6-4899-b142-98706019b01e","Type":"ContainerDied","Data":"17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c"} Jul 31 15:39:20.041989 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.041898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9" event={"ID":"baa3fa5e-7cc6-4899-b142-98706019b01e","Type":"ContainerDied","Data":"9685b51f784555eddc4b73174d82779f9b169d0f0553b26cf92c6af2508d684c"} Jul 31 15:39:20.041989 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.041920 2579 scope.go:117] "RemoveContainer" containerID="17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c" Jul 31 15:39:20.057467 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.057449 2579 scope.go:117] "RemoveContainer" containerID="17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c" Jul 31 15:39:20.057712 ip-10-0-136-197 kubenswrapper[2579]: E0731 15:39:20.057693 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c\": container with ID starting with 17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c not found: ID does not exist" containerID="17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c" Jul 31 15:39:20.057770 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.057718 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c"} err="failed to get container status \"17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c\": rpc error: code = NotFound desc = could not find container \"17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c\": container with ID starting with 17ff9e789aeeefe0d4c0bd6e95ba44cc47acc1be4955a67d0593b65c6127290c not found: ID does not exist" Jul 31 15:39:20.066632 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.066610 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9"] Jul 31 15:39:20.073786 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:20.073767 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7902a-75876bd9fb-dtnk9"] Jul 31 15:39:21.042443 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:21.042411 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" path="/var/lib/kubelet/pods/baa3fa5e-7cc6-4899-b142-98706019b01e/volumes" Jul 31 15:39:22.633676 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:22.633643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:22.853683 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:22.853645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:22.953327 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:22.953248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:25.600473 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:25.600441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-268vx_c6cc103b-7120-4a5e-98a5-c36a675afd9a/global-pull-secret-syncer/0.log" Jul 31 15:39:25.778002 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:25.777972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" Jul 31 15:39:25.934962 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:25.934872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-197.ec2.internal_410039805fdc205adf87c72964399a65/haproxy/0.log" Jul 31 15:39:28.715288 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:28.715246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:28.793992 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:28.793958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dp59z_cb78c338-1ab4-400b-9129-ee09898ba076/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:30.182821 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.182787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/alertmanager/0.log" Jul 31 15:39:30.211137 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.211110 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/config-reloader/0.log" Jul 31 15:39:30.253100 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.253079 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/kube-rbac-proxy-web/0.log" Jul 31 15:39:30.308384 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.308361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/kube-rbac-proxy/0.log" Jul 31 15:39:30.342194 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.342176 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/kube-rbac-proxy-metric/0.log" Jul 31 15:39:30.394489 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.394463 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/prom-label-proxy/0.log" Jul 31 15:39:30.436222 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.436145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1769423c-b008-4900-bfa6-3df31083be09/init-config-reloader/0.log" Jul 31 15:39:30.517730 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.517702 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-q8zhg_17c3766b-63e7-4c07-b9bb-705967894804/kube-state-metrics/0.log" Jul 31 15:39:30.543097 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.543075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-q8zhg_17c3766b-63e7-4c07-b9bb-705967894804/kube-rbac-proxy-main/0.log" Jul 31 15:39:30.572839 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.572819 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-q8zhg_17c3766b-63e7-4c07-b9bb-705967894804/kube-rbac-proxy-self/0.log" Jul 31 15:39:30.609719 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.609698 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55b885979c-7jbf5_3138f33c-618d-477f-a525-768015287d68/metrics-server/0.log" Jul 31 15:39:30.765384 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.765325 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksfcc_85aa8594-3c6a-4811-b980-0f85ad6ea5cd/node-exporter/0.log" Jul 31 15:39:30.800824 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.800802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksfcc_85aa8594-3c6a-4811-b980-0f85ad6ea5cd/kube-rbac-proxy/0.log" Jul 31 15:39:30.840320 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.840298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksfcc_85aa8594-3c6a-4811-b980-0f85ad6ea5cd/init-textfile/0.log" Jul 31 15:39:30.954162 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.954143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7dcj9_37f783aa-e1c5-4cac-9b07-984020e95f99/kube-rbac-proxy-main/0.log" Jul 31 15:39:30.978504 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:30.978481 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7dcj9_37f783aa-e1c5-4cac-9b07-984020e95f99/kube-rbac-proxy-self/0.log" Jul 31 15:39:31.006529 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.006510 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7dcj9_37f783aa-e1c5-4cac-9b07-984020e95f99/openshift-state-metrics/0.log" Jul 31 15:39:31.252354 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.252332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-4txrr_8551fdfd-55be-4795-aaa5-c3842e8e59bb/prometheus-operator/0.log" Jul 31 15:39:31.277500 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.277477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-4txrr_8551fdfd-55be-4795-aaa5-c3842e8e59bb/kube-rbac-proxy/0.log" Jul 31 15:39:31.314981 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.314960 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-n64h9_b9107920-90ed-4dc3-a6bf-4254ab27d241/prometheus-operator-admission-webhook/0.log" Jul 31 15:39:31.370140 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.370117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ccbffddf5-z4cx4_9f642655-2d43-4d64-b3e7-aa215996eb57/telemeter-client/0.log" Jul 31 15:39:31.421517 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.421495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ccbffddf5-z4cx4_9f642655-2d43-4d64-b3e7-aa215996eb57/reload/0.log" Jul 31 15:39:31.469324 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:31.469300 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ccbffddf5-z4cx4_9f642655-2d43-4d64-b3e7-aa215996eb57/kube-rbac-proxy/0.log" Jul 31 15:39:33.710747 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.710716 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n"] Jul 31 15:39:33.711124 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.711072 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" Jul 31 15:39:33.711124 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.711085 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" Jul 31 15:39:33.711124 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.711092 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" Jul 31 15:39:33.711124 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.711097 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" Jul 31 15:39:33.711251 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.711162 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="adaf092f-278d-4453-88df-4af746f15dee" containerName="splitter-graph-faf8d" Jul 31 15:39:33.711251 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.711169 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa3fa5e-7cc6-4899-b142-98706019b01e" containerName="switch-graph-7902a" Jul 31 15:39:33.714828 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.714812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.719140 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.719119 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cd56f\"/\"kube-root-ca.crt\"" Jul 31 15:39:33.720204 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.720183 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cd56f\"/\"default-dockercfg-mzp76\"" Jul 31 15:39:33.720338 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.720322 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cd56f\"/\"openshift-service-ca.crt\"" Jul 31 15:39:33.729127 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.729106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n"] Jul 31 15:39:33.859796 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.859762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-podres\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.859962 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.859805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-proc\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.859962 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.859893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sz9v\" (UniqueName: \"kubernetes.io/projected/b62cb82c-6f71-4636-a378-8d140d23f4ff-kube-api-access-8sz9v\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.860086 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.859978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-lib-modules\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.860086 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.860049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-sys\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.919575 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.919553 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68c56d5c66-nnpzb_93141fa9-e049-4ca8-ad78-a460628a9f7f/console/0.log" Jul 31 15:39:33.958360 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.958336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-9pbbl_fbffa3c6-9649-47fe-88c0-efd5cd532622/download-server/0.log" Jul 31 15:39:33.961392 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-sys\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961455 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-podres\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961455 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-proc\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961527 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sz9v\" (UniqueName: \"kubernetes.io/projected/b62cb82c-6f71-4636-a378-8d140d23f4ff-kube-api-access-8sz9v\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961527 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-lib-modules\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961595 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-proc\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961595 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961535 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-sys\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961669 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-lib-modules\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.961669 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.961618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b62cb82c-6f71-4636-a378-8d140d23f4ff-podres\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:33.970851 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:33.970824 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sz9v\" (UniqueName: \"kubernetes.io/projected/b62cb82c-6f71-4636-a378-8d140d23f4ff-kube-api-access-8sz9v\") pod \"perf-node-gather-daemonset-xhj6n\" (UID: \"b62cb82c-6f71-4636-a378-8d140d23f4ff\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:34.024563 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:34.024533 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:34.156863 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:34.156836 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n"] Jul 31 15:39:34.158842 ip-10-0-136-197 kubenswrapper[2579]: W0731 15:39:34.158810 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb62cb82c_6f71_4636_a378_8d140d23f4ff.slice/crio-5f3dff5005b6267085601a0597800a9faa340190a93ece063c5b8298a4e671d3 WatchSource:0}: Error finding container 5f3dff5005b6267085601a0597800a9faa340190a93ece063c5b8298a4e671d3: Status 404 returned error can't find the container with id 5f3dff5005b6267085601a0597800a9faa340190a93ece063c5b8298a4e671d3 Jul 31 15:39:35.111065 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.111027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" event={"ID":"b62cb82c-6f71-4636-a378-8d140d23f4ff","Type":"ContainerStarted","Data":"a86ef23dc5bac7d53b28174e1705de00d601d7f906a610fa38467b3cb42b9454"} Jul 31 15:39:35.111430 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.111089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" event={"ID":"b62cb82c-6f71-4636-a378-8d140d23f4ff","Type":"ContainerStarted","Data":"5f3dff5005b6267085601a0597800a9faa340190a93ece063c5b8298a4e671d3"} Jul 31 15:39:35.111430 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.111153 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:35.145353 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.145311 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" podStartSLOduration=2.145297287 podStartE2EDuration="2.145297287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 15:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:39:35.142772445 +0000 UTC m=+3096.602385823" watchObservedRunningTime="2026-07-31 15:39:35.145297287 +0000 UTC m=+3096.604910664" Jul 31 15:39:35.672082 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.672029 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jn8r2_560b6bef-50d2-4856-ba18-981e1230d6ab/dns/0.log" Jul 31 15:39:35.710087 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.710065 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jn8r2_560b6bef-50d2-4856-ba18-981e1230d6ab/kube-rbac-proxy/0.log" Jul 31 15:39:35.798371 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:35.798350 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s9npp_abc2fad7-2afc-4376-b4db-d951323d69e8/dns-node-resolver/0.log" Jul 31 15:39:36.245278 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:36.245251 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8458494497-8kjsc_92aadaef-e017-4512-beb1-def48edb20cb/registry/0.log" Jul 31 15:39:36.269790 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:36.269759 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-knb6c_4837bfb4-3359-4f71-9550-649536bbf1c6/node-ca/0.log" Jul 31 15:39:37.552976 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:37.552950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wm6n_706fdd7b-4f48-4841-9302-a70ccea9d7d8/serve-healthcheck-canary/0.log" Jul 31 15:39:38.214215 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:38.214191 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wq62m_b1422471-0463-44bf-a678-5d5d39526a53/kube-rbac-proxy/0.log" Jul 31 15:39:38.236692 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:38.236669 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wq62m_b1422471-0463-44bf-a678-5d5d39526a53/exporter/0.log" Jul 31 15:39:38.261537 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:38.261504 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wq62m_b1422471-0463-44bf-a678-5d5d39526a53/extractor/0.log" Jul 31 15:39:40.745127 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:40.745095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-fcc9dd4db-c7k5k_fa127f85-8294-4e0a-90ad-4b2f222e2fcf/manager/0.log" Jul 31 15:39:40.786548 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:40.786518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-lwrcr_3ad60214-3e65-4953-bf8b-8507eb987b89/manager/0.log" Jul 31 15:39:41.125889 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:41.125861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-xhj6n" Jul 31 15:39:45.928856 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:45.928755 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-ckk94_462e236b-2119-4298-ad5f-92693c0bc669/migrator/0.log" Jul 31 15:39:45.952409 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:45.952390 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-ckk94_462e236b-2119-4298-ad5f-92693c0bc669/graceful-termination/0.log" Jul 31 15:39:47.281405 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.281373 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/kube-multus-additional-cni-plugins/0.log" Jul 31 15:39:47.307994 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.307968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/egress-router-binary-copy/0.log" Jul 31 15:39:47.370034 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.370016 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/cni-plugins/0.log" Jul 31 15:39:47.432386 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.432365 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/bond-cni-plugin/0.log" Jul 31 15:39:47.461241 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.461221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/routeoverride-cni/0.log" Jul 31 15:39:47.484910 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.484864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/whereabouts-cni-bincopy/0.log" Jul 31 15:39:47.516720 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.516699 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrs6x_abd693c7-86e2-473d-9233-82d0b4e434ad/whereabouts-cni/0.log" Jul 31 15:39:47.963321 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:47.963290 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fffbd_ed810c79-b9a7-4d79-b66b-266e18a9b254/kube-multus/0.log" Jul 31 15:39:48.054678 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:48.054654 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bcwrf_9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b/network-metrics-daemon/0.log" Jul 31 15:39:48.077162 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:48.077132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bcwrf_9974ba4e-3f44-4a3b-a0d7-ccd4ac1c1f9b/kube-rbac-proxy/0.log" Jul 31 15:39:49.391474 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.391441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-controller/0.log" Jul 31 15:39:49.413565 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.413535 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/1.log" Jul 31 15:39:49.413714 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.413571 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovn-acl-logging/0.log" Jul 31 15:39:49.432104 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.432081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/kube-rbac-proxy-node/0.log" Jul 31 15:39:49.456925 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.456903 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/kube-rbac-proxy-ovn-metrics/0.log" Jul 31 15:39:49.479213 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.479193 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/northd/0.log" Jul 31 15:39:49.502609 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.502574 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/nbdb/0.log" Jul 31 15:39:49.527100 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.527079 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/sbdb/0.log" Jul 31 15:39:49.569073 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:49.569050 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qnsmj_e0de3da3-09ef-44f3-876a-de6275d16f7b/ovnkube-controller/0.log" Jul 31 15:39:50.616906 ip-10-0-136-197 kubenswrapper[2579]: I0731 15:39:50.616876 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-d8rt9_f7b865db-d41b-4716-ae2b-3c442726bc38/network-check-target-container/0.log"