Jul 14 13:53:50.478259 ip-10-0-128-255 systemd[1]: Starting Kubernetes Kubelet... Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.946439 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951442 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951462 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951466 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951469 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951473 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951476 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951479 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 13:53:51.037993 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951482 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 13:53:51.024437 ip-10-0-128-255 systemd[1]: Started Kubernetes Kubelet. Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951486 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951488 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951491 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951494 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951497 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951499 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951503 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951507 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951517 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951520 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951523 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951525 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951528 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951531 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951533 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951536 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951538 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951541 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951544 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 13:53:51.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951547 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951550 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951552 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951555 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951557 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951560 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951562 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951565 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951568 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951570 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951573 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951576 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951578 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951581 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951584 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951586 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951589 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951591 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951594 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 13:53:51.041078 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951597 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951600 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951603 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951605 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951608 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951611 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951613 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951616 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951619 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951621 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951624 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951628 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951630 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951633 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951635 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951638 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951642 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951647 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951651 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 13:53:51.050089 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951654 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951657 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951660 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951663 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951666 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951668 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951673 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951676 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951679 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951681 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951684 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951686 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951689 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951692 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951695 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951698 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951701 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951703 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951706 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951708 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951711 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 13:53:51.051280 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951713 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951716 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951718 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951721 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951723 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951726 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951728 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951731 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951733 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951736 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951739 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951741 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.951744 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952475 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952483 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952486 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952490 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952493 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952496 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952499 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 13:53:51.057178 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952502 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952504 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952507 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952509 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952512 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952515 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952521 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952524 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952526 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952529 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952531 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952534 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952537 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952540 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952542 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952545 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952548 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952550 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952555 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952558 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 13:53:51.057948 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952562 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952565 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952567 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952570 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952572 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952575 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952578 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952580 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952583 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952586 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952591 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952594 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952596 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952599 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952602 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952604 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952606 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952609 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952611 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 13:53:51.062651 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952615 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952618 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952620 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952623 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952625 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952628 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952630 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952633 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952635 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952638 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952641 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952643 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952647 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952650 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952653 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952656 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952659 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952662 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952665 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952667 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 13:53:51.063381 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952670 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952673 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952675 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952679 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952682 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952684 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952687 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952689 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952692 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952695 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952697 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952700 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952703 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952713 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952716 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952719 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952723 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952727 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952730 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952733 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 13:53:51.064983 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952735 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952738 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952740 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952743 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952745 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952748 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952750 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952753 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952755 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952758 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952760 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952764 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.952767 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953167 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953174 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953179 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953183 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953186 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953189 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 13:53:51.065703 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953191 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953194 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953197 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953200 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953203 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953206 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953209 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953211 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953214 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953217 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953220 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953222 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953225 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953227 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953232 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953235 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953238 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953241 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953244 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953246 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 14 13:53:51.066998 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953249 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953251 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953254 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953256 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953262 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953265 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953267 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953270 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953274 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953277 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953279 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953282 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953284 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953286 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953289 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953292 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953294 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953296 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953299 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953302 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 13:53:51.068016 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953304 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953307 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953309 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953312 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953314 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953317 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953320 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953322 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953325 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953327 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953330 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953332 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953335 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953337 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953339 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953342 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953346 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953350 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953354 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 13:53:51.069034 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953357 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953361 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953364 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953366 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953369 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953371 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953374 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953377 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953379 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953382 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953384 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953386 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953389 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953392 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953395 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953397 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953400 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953402 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953405 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953407 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 13:53:51.069578 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953410 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953412 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953414 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953417 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953419 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953422 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953426 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953429 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953432 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953437 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953440 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953442 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953445 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.953448 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953517 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953523 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953530 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953534 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953537 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953541 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953545 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 13:53:51.070352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953549 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953552 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953555 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953559 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953562 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953566 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953569 2574 flags.go:64] FLAG: --cgroup-root="" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953572 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953575 2574 flags.go:64] FLAG: --client-ca-file="" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953578 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953581 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953585 2574 flags.go:64] FLAG: --cluster-domain="" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953588 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953591 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953594 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953597 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953601 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953604 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953607 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953610 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953614 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953617 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953620 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953624 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 13:53:51.071046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953628 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953632 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953635 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953638 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953641 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953644 2574 flags.go:64] FLAG: --enable-server="true" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953647 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953652 2574 flags.go:64] FLAG: --event-burst="100" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953655 2574 flags.go:64] FLAG: --event-qps="50" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953658 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953661 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953664 2574 flags.go:64] FLAG: --eviction-hard="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953668 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953671 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953675 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953678 2574 flags.go:64] FLAG: --eviction-soft="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953681 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953684 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953687 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953690 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953693 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953696 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953699 2574 flags.go:64] FLAG: --feature-gates="" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953703 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953705 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 13:53:51.072293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953709 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953712 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953715 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953719 2574 flags.go:64] FLAG: --help="false" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953722 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-128-255.ec2.internal" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953725 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953728 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953733 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953736 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953739 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953742 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953745 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953748 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953751 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953754 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953757 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953759 2574 flags.go:64] FLAG: --kube-reserved="" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953762 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953766 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953769 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953772 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953774 2574 flags.go:64] FLAG: --lock-file="" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953777 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953781 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 13:53:51.073038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953784 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953789 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953792 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953795 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953798 2574 flags.go:64] FLAG: --logging-format="text" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953801 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953804 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953807 2574 flags.go:64] FLAG: --manifest-url="" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953810 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953814 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953817 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953823 2574 flags.go:64] FLAG: --max-pods="110" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953825 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953828 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953831 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953835 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953839 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953841 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953844 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953851 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953854 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953857 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953860 2574 flags.go:64] FLAG: --pod-cidr="" Jul 14 13:53:51.293464 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953863 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953869 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953872 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953875 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953878 2574 flags.go:64] FLAG: --port="10250" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953881 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953884 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0945512dd34e81ca9" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953887 2574 flags.go:64] FLAG: --qos-reserved="" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953891 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953894 2574 flags.go:64] FLAG: --register-node="true" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953897 2574 flags.go:64] FLAG: --register-with-taints="" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953900 2574 flags.go:64] FLAG: --registry-burst="10" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953903 2574 flags.go:64] FLAG: --registry-qps="5" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953906 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953909 2574 flags.go:64] FLAG: --reserved-memory="" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953925 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953928 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953931 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953935 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953937 2574 flags.go:64] FLAG: --runonce="false" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953940 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953945 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953948 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953951 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953959 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953962 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 13:53:51.315359 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953965 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953969 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953971 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953975 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953978 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953980 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953984 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953987 2574 flags.go:64] FLAG: --system-cgroups="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953990 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953996 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.953999 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954002 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954006 2574 flags.go:64] FLAG: --tls-min-version="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954009 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954011 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954015 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954018 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954021 2574 flags.go:64] FLAG: --v="2" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954025 2574 flags.go:64] FLAG: --version="false" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954028 2574 flags.go:64] FLAG: --vmodule="" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954032 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.954035 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954147 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954151 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 13:53:51.318405 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954154 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954158 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954162 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954166 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954169 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954172 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954176 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954179 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954181 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954184 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954187 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954189 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954192 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954194 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954197 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954199 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954202 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954204 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954207 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954209 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 13:53:51.319898 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954212 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954214 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954217 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954219 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954222 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954225 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954227 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954230 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954232 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954235 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954238 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954241 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954243 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954247 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954251 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954255 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954258 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954261 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954265 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 13:53:51.322510 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954268 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954270 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954273 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954276 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954278 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954280 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954283 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954286 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954288 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954291 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954293 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954296 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954298 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954301 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954304 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954307 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954309 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954312 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954315 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954318 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 13:53:51.323196 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954320 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954323 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954325 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954328 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954330 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954333 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954335 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954338 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954342 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954344 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954347 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954351 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954354 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954356 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954359 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954361 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954365 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954369 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954372 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 13:53:51.323938 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954375 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954378 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954380 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954383 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954386 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954389 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954391 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954394 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954397 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954399 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954402 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954404 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954407 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954410 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954412 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954415 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954417 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954420 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 13:53:51.324502 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.954422 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.955090 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.962296 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.962310 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.962323 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.962329 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962383 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962388 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962391 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962394 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962397 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962400 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962403 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962406 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962409 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 13:53:51.325324 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962411 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962414 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962416 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962419 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962422 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962424 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962427 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962429 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962432 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962435 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962437 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962440 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962443 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962446 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962449 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962452 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962456 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962459 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962462 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 13:53:51.325799 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962465 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962468 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962470 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962473 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962475 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962478 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962480 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962483 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962486 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962488 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962490 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962493 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962496 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962498 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962502 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962504 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962507 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962509 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962512 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962514 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 13:53:51.326670 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962519 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962522 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962525 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962528 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962531 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962534 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962537 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962540 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962544 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962547 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962550 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962552 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962555 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962557 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962560 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962562 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962565 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962567 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962570 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962572 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 13:53:51.327268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962575 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962578 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962580 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962582 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962585 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962588 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962590 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962592 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962595 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962597 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962601 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962603 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962606 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962610 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962613 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962617 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962619 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962622 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962626 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 13:53:51.327852 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962629 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962632 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962635 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962638 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962641 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962644 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962647 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962650 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962653 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962655 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962658 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962661 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.962666 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962774 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962778 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 13:53:51.328717 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962782 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962786 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962789 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962792 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962795 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962798 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962800 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962803 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962805 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962808 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962810 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962813 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962816 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962818 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962820 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962823 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962826 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962832 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962835 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 13:53:52.867406 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962838 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962840 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962843 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962846 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962848 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962851 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962853 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962856 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962858 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962861 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962863 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962866 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962868 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962871 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962873 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962876 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962878 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962881 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962883 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962886 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 13:53:52.868330 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962888 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962891 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962893 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962896 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962898 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962901 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962904 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962906 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962908 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962930 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962935 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962938 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962941 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962944 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962946 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962949 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962952 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962954 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962957 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962959 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 13:53:52.869081 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962962 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962964 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962967 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962969 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962973 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962976 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962979 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962982 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962985 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962988 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962991 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962994 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962996 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.962999 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963001 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963003 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963006 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963009 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963011 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963014 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 13:53:52.869704 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963016 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963020 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963025 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963028 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963031 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963033 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963036 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963038 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963041 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963043 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963046 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963049 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963051 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963054 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963057 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963061 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963064 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 13:53:52.870293 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:50.963066 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.963071 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.963167 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.967131 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.968826 2574 server.go:1019] "Starting client certificate rotation" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.968939 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.968978 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.971701 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.972874 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.986725 2574 log.go:25] "Validated CRI v1 runtime API" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.989255 2574 log.go:25] "Validated CRI v1 image API" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.990056 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 13:53:52.870944 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.993197 2574 fs.go:135] Filesystem UUIDs: map[5fc7a7ce-7ca3-4bd9-a268-3f60b11e39f6:/dev/nvme0n1p4 6a4e0f70-9487-472e-bace-a388eed7699e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 14 13:53:52.871330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.993213 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.999281 2574 manager.go:216] Machine: {Timestamp:2026-07-14 13:53:50.997751302 +0000 UTC m=+0.377119557 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098708 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c1bdb02756047f8f7b9e2ac95905f SystemUUID:ec2c1bdb-0275-6047-f8f7-b9e2ac95905f BootID:3f4b363c-2c7e-40a5-9f18-54aabed91721 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:f9:62:ec:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:f9:62:ec:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:3b:0e:4f:0f:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.999384 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:50.999469 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.001764 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.003039 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.003062 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 13:53:53.081356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.003889 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.003901 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.003908 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.004769 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.006710 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011273 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011397 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011424 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011434 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011456 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011469 2574 kubelet.go:398] "Adding apiserver pod source" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011479 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011835 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.011854 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.015874 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018465 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018493 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018647 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018659 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018664 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018670 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018678 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.018684 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.019379 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.019388 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.019397 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.019402 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.019411 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.019419 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.020362 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.020375 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.022886 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.022897 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.022957 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.023593 2574 server.go:1268] "Started kubelet" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.023675 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.023683 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.023750 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.027215 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 13:53:53.082339 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.028958 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.029850 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.033634 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-255.ec2.internal.18c22c68cd3b3521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-255.ec2.internal,UID:ip-10-0-128-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-255.ec2.internal,},FirstTimestamp:2026-07-14 13:53:51.023568161 +0000 UTC m=+0.402936406,LastTimestamp:2026-07-14 13:53:51.023568161 +0000 UTC m=+0.402936406,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-255.ec2.internal,}" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.037264 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.037279 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.037374 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.038359 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.038375 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.038505 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.038512 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039115 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039129 2574 factory.go:55] Registering systemd factory Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039139 2574 factory.go:223] Registration of the systemd container factory successfully Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039458 2574 factory.go:153] Registering CRI-O factory Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039479 2574 factory.go:223] Registration of the crio container factory successfully Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039506 2574 factory.go:103] Registering Raw factory Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039520 2574 manager.go:1196] Started watching for new ooms in manager Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.039992 2574 manager.go:349] Starting recovery of all containers Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.040340 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.049231 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.049337 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.049830 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vhfm4" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.051810 2574 manager.go:354] Recovery completed Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.056202 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.065158 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.065273 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vhfm4" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066031 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066068 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066084 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066808 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066819 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066824 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.083951 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.066833 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.067581 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.067606 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.067621 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.068910 2574 policy_none.go:49] "None policy: Start" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.068973 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.068990 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.071000 2574 policy_none.go:47] "Start" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.115626 2574 manager.go:337] "Starting Device Plugin manager" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.115656 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.115665 2574 server.go:87] "Starting device plugin registration server" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.115879 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.115893 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.116048 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.116128 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.116138 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.116576 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.116616 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.169310 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.169350 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.169374 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.169411 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.171987 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.216057 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.217007 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.217044 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.217054 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.217076 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.226441 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.226461 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-255.ec2.internal\": node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.253935 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.270281 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal"] Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.270347 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.272551 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.272580 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.272591 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.274957 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.275074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.084883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.275115 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.280718 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.280741 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.280751 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.280718 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.280808 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.280821 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.283035 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.283057 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.283740 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientMemory" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.283769 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.283781 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeHasSufficientPID" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.316153 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-255.ec2.internal\" not found" node="ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.321904 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-255.ec2.internal\" not found" node="ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.355011 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.441461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c78769e0bb1c929f58ca5348a71d49d6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-255.ec2.internal\" (UID: \"c78769e0bb1c929f58ca5348a71d49d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.441491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2068ee1411cc3ce9976104e542c0a14a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal\" (UID: \"2068ee1411cc3ce9976104e542c0a14a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:51.441518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2068ee1411cc3ce9976104e542c0a14a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal\" (UID: \"2068ee1411cc3ce9976104e542c0a14a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:51.455548 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.853240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c78769e0bb1c929f58ca5348a71d49d6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-255.ec2.internal\" (UID: \"c78769e0bb1c929f58ca5348a71d49d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.853273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2068ee1411cc3ce9976104e542c0a14a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal\" (UID: \"2068ee1411cc3ce9976104e542c0a14a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.085877 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.853290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2068ee1411cc3ce9976104e542c0a14a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal\" (UID: \"2068ee1411cc3ce9976104e542c0a14a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.853350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c78769e0bb1c929f58ca5348a71d49d6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-255.ec2.internal\" (UID: \"c78769e0bb1c929f58ca5348a71d49d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.853354 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2068ee1411cc3ce9976104e542c0a14a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal\" (UID: \"2068ee1411cc3ce9976104e542c0a14a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.853378 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2068ee1411cc3ce9976104e542c0a14a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal\" (UID: \"2068ee1411cc3ce9976104e542c0a14a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:52.867450 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.929645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:52.935707 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:52.968420 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.086574 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:53.069304 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.291104 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:53.169968 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.291104 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:53.270768 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.291104 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.278916 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 13:53:53.291104 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.279056 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 13:53:53.371709 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:53.371617 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-255.ec2.internal\" not found" Jul 14 13:53:53.381789 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.381753 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 13:48:52 +0000 UTC" deadline="2027-12-16 00:24:57.066059109 +0000 UTC" Jul 14 13:53:53.381789 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.381786 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12466h31m3.684277189s" Jul 14 13:53:53.388061 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.388045 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 13:53:53.449093 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.449035 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.462391 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.462371 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 13:53:53.463670 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.463658 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" Jul 14 13:53:53.472512 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.472499 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 13:53:53.521817 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:53.521783 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2068ee1411cc3ce9976104e542c0a14a.slice/crio-bf1c8cfd4e998669c1cef071d986e20af79de41207c515d88f62dbfd3835fe6a WatchSource:0}: Error finding container bf1c8cfd4e998669c1cef071d986e20af79de41207c515d88f62dbfd3835fe6a: Status 404 returned error can't find the container with id bf1c8cfd4e998669c1cef071d986e20af79de41207c515d88f62dbfd3835fe6a Jul 14 13:53:53.528918 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.528903 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 13:53:53.534684 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:53.534660 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78769e0bb1c929f58ca5348a71d49d6.slice/crio-18e62ae4c588159557a81ebd9c9e66aa77312e27ab97ffc17b46340ce7a28c61 WatchSource:0}: Error finding container 18e62ae4c588159557a81ebd9c9e66aa77312e27ab97ffc17b46340ce7a28c61: Status 404 returned error can't find the container with id 18e62ae4c588159557a81ebd9c9e66aa77312e27ab97ffc17b46340ce7a28c61 Jul 14 13:53:53.556871 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.556847 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 13:53:53.750532 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:53.750497 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 13:53:54.323909 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.323873 2574 apiserver.go:52] "Watching apiserver" Jul 14 13:53:54.332748 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.332716 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 13:53:54.333092 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.333066 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh","openshift-dns/node-resolver-7ffkp","openshift-image-registry/node-ca-6247h","openshift-multus/multus-5hbmn","openshift-multus/multus-additional-cni-plugins-khhn7","openshift-multus/network-metrics-daemon-rkj9w","kube-system/konnectivity-agent-cwhkl","openshift-cluster-node-tuning-operator/tuned-rd2p5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal","openshift-network-diagnostics/network-check-target-zb2bw","openshift-network-operator/iptables-alerter-dxqz6","openshift-ovn-kubernetes/ovnkube-node-44t9t","kube-system/global-pull-secret-syncer-4c9nv","kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal"] Jul 14 13:53:54.335653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.335627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.337757 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.337728 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.337854 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.337826 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:53:54.338548 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.338216 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dw48j\"" Jul 14 13:53:54.338548 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.338411 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 13:53:54.338548 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.338456 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 13:53:54.340138 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.339976 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.342054 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.342031 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.342195 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.342166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.342650 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.342333 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nsq8f\"" Jul 14 13:53:54.342650 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.342380 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 13:53:54.342650 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.342557 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.345088 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.344361 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.345540 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.345512 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6wc74\"" Jul 14 13:53:54.345540 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.345526 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 13:53:54.345540 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.345532 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.345723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.345540 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 13:53:54.345723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.345577 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.346683 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.346496 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kqkvd\"" Jul 14 13:53:54.346683 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.346583 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 13:53:54.346960 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.346941 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 13:53:54.347508 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.347263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.347508 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.347329 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:53:54.349368 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.349293 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 13:53:54.349736 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.349713 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.351938 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.351918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.352253 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.352071 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5gcwf\"" Jul 14 13:53:54.352347 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.352330 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.352422 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.352405 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.353917 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.353894 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.354591 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.354568 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.354682 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.354598 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.355001 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.354981 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 13:53:54.355249 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.355228 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2jzxx\"" Jul 14 13:53:54.356807 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.356785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:54.356909 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.356880 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:53:54.357110 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.357091 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.357253 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.357203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5q2nw\"" Jul 14 13:53:54.357850 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.357640 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.359297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.359272 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.361741 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.361587 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.362941 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.362921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.364839 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.364818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 13:53:54.365595 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznrw\" (UniqueName: \"kubernetes.io/projected/31b08467-f3ee-431a-843f-46949d3ea475-kube-api-access-rznrw\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.365695 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-modprobe-d\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.365695 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-kubelet-config\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.365813 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-sys-fs\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.365813 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-hostroot\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.365813 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mcbsn\"" Jul 14 13:53:54.365963 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-systemd\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.365963 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-etc-kubernetes\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.365963 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.365963 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysctl-d\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.366171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.365981 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-tuned\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.366171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-cnibin\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.366171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-run\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.366171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366094 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-var-lib-kubelet\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-host\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-device-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2rzx\" (UniqueName: \"kubernetes.io/projected/477ed5e7-278b-4ce7-9b48-bc83c1760537-kube-api-access-v2rzx\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-etc-selinux\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-system-cni-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.366583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-cni-multus\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e61db8eb-06c6-4f98-a037-d431374d297b-host\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2f8\" (UniqueName: \"kubernetes.io/projected/e61db8eb-06c6-4f98-a037-d431374d297b-kube-api-access-cb2f8\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366712 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-netns\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-multus-certs\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/114c4d8c-7ecc-4682-a684-3224e6dde0f1-tmp\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e61db8eb-06c6-4f98-a037-d431374d297b-serviceca\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-conf-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.366966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-kubernetes\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-lib-modules\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-sys\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/566a70ee-bc1e-464d-a28d-24f051cbb7ae-agent-certs\") pod \"konnectivity-agent-cwhkl\" (UID: \"566a70ee-bc1e-464d-a28d-24f051cbb7ae\") " pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-cni-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8b669d0-882d-4d49-8c63-c3cc1f064b54-cni-binary-copy\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-socket-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-os-release\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-daemon-config\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367367 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-system-cni-dir\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysconfig\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-dbus\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54qb\" (UniqueName: \"kubernetes.io/projected/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-kube-api-access-j54qb\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.367561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/566a70ee-bc1e-464d-a28d-24f051cbb7ae-konnectivity-ca\") pod \"konnectivity-agent-cwhkl\" (UID: \"566a70ee-bc1e-464d-a28d-24f051cbb7ae\") " pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-socket-dir-parent\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-registration-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-k8s-cni-cncf-io\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-kubelet\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58fzs\" (UniqueName: \"kubernetes.io/projected/c8b669d0-882d-4d49-8c63-c3cc1f064b54-kube-api-access-58fzs\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-os-release\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367570 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysctl-conf\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkh5s\" (UniqueName: \"kubernetes.io/projected/114c4d8c-7ecc-4682-a684-3224e6dde0f1-kube-api-access-wkh5s\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-cni-bin\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-cnibin\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367864 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 13:53:54.368031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.367926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-cni-binary-copy\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.368599 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.368152 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 13:53:54.368599 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.368266 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 13:53:54.368911 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.368848 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfmvs\"" Jul 14 13:53:54.368911 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.368889 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 13:53:54.369343 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.369319 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 13:53:54.369438 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.369373 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 13:53:54.386804 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.386774 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f75gl" Jul 14 13:53:54.392894 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.392786 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f75gl" Jul 14 13:53:54.452777 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.452753 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 13:53:54.468096 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-systemd-units\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-run-ovn-kubernetes\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovn-node-metrics-cert\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-k8s-cni-cncf-io\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-kubelet\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58fzs\" (UniqueName: \"kubernetes.io/projected/c8b669d0-882d-4d49-8c63-c3cc1f064b54-kube-api-access-58fzs\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-os-release\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.468245 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-host-slash\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-k8s-cni-cncf-io\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-kubelet\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-node-log\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysctl-conf\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-os-release\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkh5s\" (UniqueName: \"kubernetes.io/projected/114c4d8c-7ecc-4682-a684-3224e6dde0f1-kube-api-access-wkh5s\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-cni-bin\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-cnibin\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-cni-binary-copy\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznrw\" (UniqueName: \"kubernetes.io/projected/31b08467-f3ee-431a-843f-46949d3ea475-kube-api-access-rznrw\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-modprobe-d\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-cni-bin\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-kubelet-config\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.468653 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-sys-fs\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468655 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-modprobe-d\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468664 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysctl-conf\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-cnibin\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-slash\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-kubelet-config\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468738 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-sys-fs\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-hostroot\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-systemd\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-cni-netd\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovnkube-script-lib\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-etc-kubernetes\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-systemd\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.469333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468876 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-hostroot\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468917 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-etc-kubernetes\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysctl-d\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-tuned\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.468988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-cnibin\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-run\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-cni-binary-copy\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-var-lib-kubelet\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-host\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-device-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469124 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-cnibin\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.470010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2rzx\" (UniqueName: \"kubernetes.io/projected/477ed5e7-278b-4ce7-9b48-bc83c1760537-kube-api-access-v2rzx\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-systemd\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-etc-selinux\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-log-socket\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-cni-bin\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-system-cni-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-cni-multus\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-etc-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469367 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469398 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e61db8eb-06c6-4f98-a037-d431374d297b-host\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469444 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-run\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.470610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469392 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysctl-d\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469461 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-device-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.469424 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2f8\" (UniqueName: \"kubernetes.io/projected/e61db8eb-06c6-4f98-a037-d431374d297b-kube-api-access-cb2f8\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-netns\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-multus-certs\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.469552 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-env-overrides\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469584 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e61db8eb-06c6-4f98-a037-d431374d297b-host\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.469600 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:53:54.969566385 +0000 UTC m=+3.037665233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469618 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-netns\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469632 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469632 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-var-lib-cni-multus\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469645 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-host-run-multus-certs\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.471252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469550 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-etc-selinux\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-var-lib-kubelet\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469081 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-host\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469700 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-system-cni-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.469734 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:53:54.969717151 +0000 UTC m=+3.037815991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/114c4d8c-7ecc-4682-a684-3224e6dde0f1-tmp\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e61db8eb-06c6-4f98-a037-d431374d297b-serviceca\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19746321-8c32-49e7-8574-c1d3bb66276f-tmp-dir\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.469972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-run-netns\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-conf-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-kubernetes\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-conf-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-lib-modules\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.472474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs4ls\" (UniqueName: \"kubernetes.io/projected/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-kube-api-access-xs4ls\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470175 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-kubernetes\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-sys\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470222 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-lib-modules\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19746321-8c32-49e7-8574-c1d3bb66276f-hosts-file\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470246 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31b08467-f3ee-431a-843f-46949d3ea475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-ovn\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470250 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-sys\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470289 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e61db8eb-06c6-4f98-a037-d431374d297b-serviceca\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwj2\" (UniqueName: \"kubernetes.io/projected/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-kube-api-access-lnwj2\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/566a70ee-bc1e-464d-a28d-24f051cbb7ae-agent-certs\") pod \"konnectivity-agent-cwhkl\" (UID: \"566a70ee-bc1e-464d-a28d-24f051cbb7ae\") " pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-cni-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8b669d0-882d-4d49-8c63-c3cc1f064b54-cni-binary-copy\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-socket-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.473084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-iptables-alerter-script\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-var-lib-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-cni-dir\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovnkube-config\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-socket-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-os-release\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470825 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-os-release\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-daemon-config\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-system-cni-dir\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.470976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysconfig\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-dbus\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471048 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-system-cni-dir\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54qb\" (UniqueName: \"kubernetes.io/projected/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-kube-api-access-j54qb\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.473723 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpbf\" (UniqueName: \"kubernetes.io/projected/19746321-8c32-49e7-8574-c1d3bb66276f-kube-api-access-bxpbf\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471112 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-sysconfig\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/566a70ee-bc1e-464d-a28d-24f051cbb7ae-konnectivity-ca\") pod \"konnectivity-agent-cwhkl\" (UID: \"566a70ee-bc1e-464d-a28d-24f051cbb7ae\") " pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471133 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8b669d0-882d-4d49-8c63-c3cc1f064b54-cni-binary-copy\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471154 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-socket-dir-parent\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-registration-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471204 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-dbus\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-kubelet\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471264 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31b08467-f3ee-431a-843f-46949d3ea475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471336 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-socket-dir-parent\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471336 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/477ed5e7-278b-4ce7-9b48-bc83c1760537-registration-dir\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.471645 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/566a70ee-bc1e-464d-a28d-24f051cbb7ae-konnectivity-ca\") pod \"konnectivity-agent-cwhkl\" (UID: \"566a70ee-bc1e-464d-a28d-24f051cbb7ae\") " pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.472256 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8b669d0-882d-4d49-8c63-c3cc1f064b54-multus-daemon-config\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.473452 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/114c4d8c-7ecc-4682-a684-3224e6dde0f1-etc-tuned\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.473632 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/114c4d8c-7ecc-4682-a684-3224e6dde0f1-tmp\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.474327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.473952 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/566a70ee-bc1e-464d-a28d-24f051cbb7ae-agent-certs\") pod \"konnectivity-agent-cwhkl\" (UID: \"566a70ee-bc1e-464d-a28d-24f051cbb7ae\") " pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.478334 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.478312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2f8\" (UniqueName: \"kubernetes.io/projected/e61db8eb-06c6-4f98-a037-d431374d297b-kube-api-access-cb2f8\") pod \"node-ca-6247h\" (UID: \"e61db8eb-06c6-4f98-a037-d431374d297b\") " pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.478856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.478833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznrw\" (UniqueName: \"kubernetes.io/projected/31b08467-f3ee-431a-843f-46949d3ea475-kube-api-access-rznrw\") pod \"multus-additional-cni-plugins-khhn7\" (UID: \"31b08467-f3ee-431a-843f-46949d3ea475\") " pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.479030 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.479005 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2rzx\" (UniqueName: \"kubernetes.io/projected/477ed5e7-278b-4ce7-9b48-bc83c1760537-kube-api-access-v2rzx\") pod \"aws-ebs-csi-driver-node-pjjrh\" (UID: \"477ed5e7-278b-4ce7-9b48-bc83c1760537\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.479108 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.479083 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58fzs\" (UniqueName: \"kubernetes.io/projected/c8b669d0-882d-4d49-8c63-c3cc1f064b54-kube-api-access-58fzs\") pod \"multus-5hbmn\" (UID: \"c8b669d0-882d-4d49-8c63-c3cc1f064b54\") " pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.479867 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.479846 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkh5s\" (UniqueName: \"kubernetes.io/projected/114c4d8c-7ecc-4682-a684-3224e6dde0f1-kube-api-access-wkh5s\") pod \"tuned-rd2p5\" (UID: \"114c4d8c-7ecc-4682-a684-3224e6dde0f1\") " pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.480913 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.480886 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54qb\" (UniqueName: \"kubernetes.io/projected/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-kube-api-access-j54qb\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.485004 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.484542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" event={"ID":"c78769e0bb1c929f58ca5348a71d49d6","Type":"ContainerStarted","Data":"18e62ae4c588159557a81ebd9c9e66aa77312e27ab97ffc17b46340ce7a28c61"} Jul 14 13:53:54.485672 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.485652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" event={"ID":"2068ee1411cc3ce9976104e542c0a14a","Type":"ContainerStarted","Data":"bf1c8cfd4e998669c1cef071d986e20af79de41207c515d88f62dbfd3835fe6a"} Jul 14 13:53:54.572252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs4ls\" (UniqueName: \"kubernetes.io/projected/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-kube-api-access-xs4ls\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.572252 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19746321-8c32-49e7-8574-c1d3bb66276f-hosts-file\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.572487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-ovn\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwj2\" (UniqueName: \"kubernetes.io/projected/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-kube-api-access-lnwj2\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-ovn\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19746321-8c32-49e7-8574-c1d3bb66276f-hosts-file\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.572487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-iptables-alerter-script\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.572487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-var-lib-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572747 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572545 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-var-lib-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572798 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovnkube-config\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572798 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpbf\" (UniqueName: \"kubernetes.io/projected/19746321-8c32-49e7-8574-c1d3bb66276f-kube-api-access-bxpbf\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.572879 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-kubelet\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572879 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-systemd-units\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572879 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-run-ovn-kubernetes\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572977 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovn-node-metrics-cert\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572977 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-host-slash\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.572977 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-node-log\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.572977 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-slash\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573098 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.572995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573098 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-cni-netd\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573098 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573020 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-iptables-alerter-script\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.573098 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovnkube-script-lib\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573098 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-systemd\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-log-socket\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-cni-bin\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-etc-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573260 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-kubelet\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-env-overrides\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19746321-8c32-49e7-8574-c1d3bb66276f-tmp-dir\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573319 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-systemd-units\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-run-netns\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573359 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-run-ovn-kubernetes\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573391 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovnkube-config\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573411 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-run-netns\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573419 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-host-slash\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-cni-bin\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-slash\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573478 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-node-log\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-log-socket\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-cni-netd\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-etc-openvswitch\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.573618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.574330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573617 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-run-systemd\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.574330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573742 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19746321-8c32-49e7-8574-c1d3bb66276f-tmp-dir\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.574330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.573935 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-env-overrides\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.574330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.574001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovnkube-script-lib\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.575665 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.575622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-ovn-node-metrics-cert\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.580655 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.580633 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:53:54.580655 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.580658 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:53:54.580818 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.580670 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:54.580818 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.580732 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:53:55.080714785 +0000 UTC m=+3.148813641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:54.582602 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.582581 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwj2\" (UniqueName: \"kubernetes.io/projected/ff6b1518-bfce-48d2-9d31-1caf6bbe1869-kube-api-access-lnwj2\") pod \"ovnkube-node-44t9t\" (UID: \"ff6b1518-bfce-48d2-9d31-1caf6bbe1869\") " pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.583271 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.583247 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs4ls\" (UniqueName: \"kubernetes.io/projected/70e446f9-3f32-4e43-bc8b-4fc7b9a7918d-kube-api-access-xs4ls\") pod \"iptables-alerter-dxqz6\" (UID: \"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d\") " pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.583361 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.583289 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpbf\" (UniqueName: \"kubernetes.io/projected/19746321-8c32-49e7-8574-c1d3bb66276f-kube-api-access-bxpbf\") pod \"node-resolver-7ffkp\" (UID: \"19746321-8c32-49e7-8574-c1d3bb66276f\") " pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.648545 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.648508 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:53:54.656214 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.656178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6247h" Jul 14 13:53:54.669875 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.669854 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hbmn" Jul 14 13:53:54.675608 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.675588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-khhn7" Jul 14 13:53:54.682264 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.682246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" Jul 14 13:53:54.689842 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.689827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" Jul 14 13:53:54.696280 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.696260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7ffkp" Jul 14 13:53:54.705822 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.705801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxqz6" Jul 14 13:53:54.711411 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.711391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:53:54.714449 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.714434 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 13:53:54.975309 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.975267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:54.975309 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:54.975311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:54.975526 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.975435 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:54.975526 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.975490 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:53:55.975476998 +0000 UTC m=+4.043575832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:54.975713 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.975690 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:54.975827 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:54.975755 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:53:55.975740541 +0000 UTC m=+4.043839374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:55.176617 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.176567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:55.176781 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.176756 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:53:55.176849 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.176786 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:53:55.176849 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.176796 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:55.176936 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.176855 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:53:56.176837116 +0000 UTC m=+4.244935949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:55.396957 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.396849 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 13:48:54 +0000 UTC" deadline="2028-03-08 04:14:06.589307623 +0000 UTC" Jul 14 13:53:55.396957 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.396915 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14462h20m11.192403519s" Jul 14 13:53:55.423275 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.423227 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477ed5e7_278b_4ce7_9b48_bc83c1760537.slice/crio-4b844d4e522deb7af3d7a8b66fbb1552ddf42c7fdf40025b12698acbd2b862d9 WatchSource:0}: Error finding container 4b844d4e522deb7af3d7a8b66fbb1552ddf42c7fdf40025b12698acbd2b862d9: Status 404 returned error can't find the container with id 4b844d4e522deb7af3d7a8b66fbb1552ddf42c7fdf40025b12698acbd2b862d9 Jul 14 13:53:55.425923 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.425832 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19746321_8c32_49e7_8574_c1d3bb66276f.slice/crio-8767b6febd8a194cf4a7aa4c8595dfb2d4069a70c4291f950d611840aed08c55 WatchSource:0}: Error finding container 8767b6febd8a194cf4a7aa4c8595dfb2d4069a70c4291f950d611840aed08c55: Status 404 returned error can't find the container with id 8767b6febd8a194cf4a7aa4c8595dfb2d4069a70c4291f950d611840aed08c55 Jul 14 13:53:55.427002 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.426982 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114c4d8c_7ecc_4682_a684_3224e6dde0f1.slice/crio-e3735ed49e8b90abe006046bd94c99a3a6ea28401d6e72e20b1916ed2496bc77 WatchSource:0}: Error finding container e3735ed49e8b90abe006046bd94c99a3a6ea28401d6e72e20b1916ed2496bc77: Status 404 returned error can't find the container with id e3735ed49e8b90abe006046bd94c99a3a6ea28401d6e72e20b1916ed2496bc77 Jul 14 13:53:55.431227 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.431202 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6b1518_bfce_48d2_9d31_1caf6bbe1869.slice/crio-100963a71655e8991ef50f43ed6ef6579dce999ad2e8057194d5efd3403518f3 WatchSource:0}: Error finding container 100963a71655e8991ef50f43ed6ef6579dce999ad2e8057194d5efd3403518f3: Status 404 returned error can't find the container with id 100963a71655e8991ef50f43ed6ef6579dce999ad2e8057194d5efd3403518f3 Jul 14 13:53:55.432408 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.432389 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b669d0_882d_4d49_8c63_c3cc1f064b54.slice/crio-0a5b0b3567e28909952c65ab00992361e45f5ae368f45c0d428bf5d6da7055a3 WatchSource:0}: Error finding container 0a5b0b3567e28909952c65ab00992361e45f5ae368f45c0d428bf5d6da7055a3: Status 404 returned error can't find the container with id 0a5b0b3567e28909952c65ab00992361e45f5ae368f45c0d428bf5d6da7055a3 Jul 14 13:53:55.433268 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.433234 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e446f9_3f32_4e43_bc8b_4fc7b9a7918d.slice/crio-f47d5a4b7947cd812ff8e2af27913d527e6d5db6c81b33161d4fd9a413b3f11e WatchSource:0}: Error finding container f47d5a4b7947cd812ff8e2af27913d527e6d5db6c81b33161d4fd9a413b3f11e: Status 404 returned error can't find the container with id f47d5a4b7947cd812ff8e2af27913d527e6d5db6c81b33161d4fd9a413b3f11e Jul 14 13:53:55.434702 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.434676 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b08467_f3ee_431a_843f_46949d3ea475.slice/crio-223183d6368da85bffd2a22ed818e372078b981126101426f36a047ac0a8024f WatchSource:0}: Error finding container 223183d6368da85bffd2a22ed818e372078b981126101426f36a047ac0a8024f: Status 404 returned error can't find the container with id 223183d6368da85bffd2a22ed818e372078b981126101426f36a047ac0a8024f Jul 14 13:53:55.435621 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.435500 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61db8eb_06c6_4f98_a037_d431374d297b.slice/crio-8111c3ebd2789be8d7d91659ab50cacba92b9e245e694060b49ce47d89280614 WatchSource:0}: Error finding container 8111c3ebd2789be8d7d91659ab50cacba92b9e245e694060b49ce47d89280614: Status 404 returned error can't find the container with id 8111c3ebd2789be8d7d91659ab50cacba92b9e245e694060b49ce47d89280614 Jul 14 13:53:55.437713 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:53:55.437694 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566a70ee_bc1e_464d_a28d_24f051cbb7ae.slice/crio-e52730b1ba8406a0700914235f42e1d6f0b43cfaeaae854799caac35075feb8d WatchSource:0}: Error finding container e52730b1ba8406a0700914235f42e1d6f0b43cfaeaae854799caac35075feb8d: Status 404 returned error can't find the container with id e52730b1ba8406a0700914235f42e1d6f0b43cfaeaae854799caac35075feb8d Jul 14 13:53:55.481810 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.481788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:55.481913 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.481890 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:53:55.481954 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.481920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:55.481984 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.481968 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:53:55.490567 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.490541 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerStarted","Data":"223183d6368da85bffd2a22ed818e372078b981126101426f36a047ac0a8024f"} Jul 14 13:53:55.491765 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.491740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxqz6" event={"ID":"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d","Type":"ContainerStarted","Data":"f47d5a4b7947cd812ff8e2af27913d527e6d5db6c81b33161d4fd9a413b3f11e"} Jul 14 13:53:55.492843 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.492820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7ffkp" event={"ID":"19746321-8c32-49e7-8574-c1d3bb66276f","Type":"ContainerStarted","Data":"8767b6febd8a194cf4a7aa4c8595dfb2d4069a70c4291f950d611840aed08c55"} Jul 14 13:53:55.493998 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.493976 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" event={"ID":"477ed5e7-278b-4ce7-9b48-bc83c1760537","Type":"ContainerStarted","Data":"4b844d4e522deb7af3d7a8b66fbb1552ddf42c7fdf40025b12698acbd2b862d9"} Jul 14 13:53:55.495044 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.495022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwhkl" event={"ID":"566a70ee-bc1e-464d-a28d-24f051cbb7ae","Type":"ContainerStarted","Data":"e52730b1ba8406a0700914235f42e1d6f0b43cfaeaae854799caac35075feb8d"} Jul 14 13:53:55.495989 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.495970 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hbmn" event={"ID":"c8b669d0-882d-4d49-8c63-c3cc1f064b54","Type":"ContainerStarted","Data":"0a5b0b3567e28909952c65ab00992361e45f5ae368f45c0d428bf5d6da7055a3"} Jul 14 13:53:55.496990 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.496968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"100963a71655e8991ef50f43ed6ef6579dce999ad2e8057194d5efd3403518f3"} Jul 14 13:53:55.498078 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.498052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" event={"ID":"114c4d8c-7ecc-4682-a684-3224e6dde0f1","Type":"ContainerStarted","Data":"e3735ed49e8b90abe006046bd94c99a3a6ea28401d6e72e20b1916ed2496bc77"} Jul 14 13:53:55.499075 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.499057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6247h" event={"ID":"e61db8eb-06c6-4f98-a037-d431374d297b","Type":"ContainerStarted","Data":"8111c3ebd2789be8d7d91659ab50cacba92b9e245e694060b49ce47d89280614"} Jul 14 13:53:55.980819 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.980730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:55.980819 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:55.980782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:55.981040 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.980901 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:55.981040 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.980983 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:53:57.980961918 +0000 UTC m=+6.049060761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:55.981040 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.980907 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:55.981227 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:55.981068 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:53:57.981048197 +0000 UTC m=+6.049147033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:56.183227 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.183174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:56.183405 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:56.183377 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:53:56.183405 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:56.183399 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:53:56.183514 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:56.183412 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:56.183514 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:56.183485 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:53:58.183452994 +0000 UTC m=+6.251551829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:56.397510 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.397445 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 13:48:54 +0000 UTC" deadline="2028-02-12 01:04:00.468282709 +0000 UTC" Jul 14 13:53:56.397510 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.397508 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13859h10m4.070778586s" Jul 14 13:53:56.481686 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.481656 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:56.481845 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:56.481786 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:53:56.522337 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.522253 2574 generic.go:356] "Generic (PLEG): container finished" podID="2068ee1411cc3ce9976104e542c0a14a" containerID="eb8849123180b8b9289282888556e6cae103f41992d09acca86578dd92272f89" exitCode=0 Jul 14 13:53:56.522498 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.522421 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" event={"ID":"2068ee1411cc3ce9976104e542c0a14a","Type":"ContainerDied","Data":"eb8849123180b8b9289282888556e6cae103f41992d09acca86578dd92272f89"} Jul 14 13:53:56.546583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:56.546461 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" event={"ID":"c78769e0bb1c929f58ca5348a71d49d6","Type":"ContainerStarted","Data":"54df54444d5fda3e342c7f694ffc6c37a6fa13743fdec44ec027aa62df2e9acc"} Jul 14 13:53:57.481688 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:57.481653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:57.482153 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:57.481809 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:53:57.482238 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:57.482210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:57.482346 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:57.482301 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:53:57.561882 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:57.561816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" event={"ID":"2068ee1411cc3ce9976104e542c0a14a","Type":"ContainerStarted","Data":"4c7cb3ca0a609aa2184b04638dec02ab42b778e156ee1b4eeb2167dcb0ba3af0"} Jul 14 13:53:57.577561 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:57.577500 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-255.ec2.internal" podStartSLOduration=4.577470974 podStartE2EDuration="4.577470974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:53:56.56344082 +0000 UTC m=+4.631539668" watchObservedRunningTime="2026-07-14 13:53:57.577470974 +0000 UTC m=+5.645569833" Jul 14 13:53:57.999461 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:57.998698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:57.999461 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:57.998755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:57.999461 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:57.998909 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:57.999461 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:57.998974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:01.998951477 +0000 UTC m=+10.067050331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:53:57.999461 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:57.999376 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:57.999461 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:57.999423 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:54:01.999409242 +0000 UTC m=+10.067508077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:53:58.200059 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:58.200018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:58.200292 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:58.200273 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:53:58.200371 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:58.200301 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:53:58.200371 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:58.200315 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:58.200466 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:58.200376 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:02.200358152 +0000 UTC m=+10.268457005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:53:58.482002 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:58.481409 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:53:58.482002 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:58.481600 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:53:59.482534 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:59.481828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:53:59.482534 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:59.482002 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:53:59.482534 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:53:59.482397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:53:59.482534 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:53:59.482488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:00.481643 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:00.481594 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:00.481836 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:00.481737 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:01.481127 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:01.481092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:01.481565 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:01.481259 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:01.481565 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:01.481488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:01.481674 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:01.481609 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:02.032665 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:02.032619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:02.032839 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:02.032671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:02.032839 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.032758 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:54:02.032839 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.032821 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:54:10.03280386 +0000 UTC m=+18.100902708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:54:02.033018 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.032758 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:54:02.033018 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.032885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:10.032871835 +0000 UTC m=+18.100970668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:54:02.234178 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:02.234137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:02.234380 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.234361 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:54:02.234515 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.234383 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:54:02.234515 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.234396 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:54:02.234515 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.234458 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:10.234438373 +0000 UTC m=+18.302537209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:54:02.482650 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:02.482616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:02.483142 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:02.482743 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:03.481592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:03.481493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:03.481592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:03.481541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:03.481824 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:03.481637 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:03.482015 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:03.481981 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:04.481775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:04.481747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:04.482261 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:04.481870 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:05.481024 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:05.480991 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:05.481224 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:05.480991 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:05.481224 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:05.481106 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:05.481224 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:05.481173 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:06.481099 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:06.481065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:06.481563 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:06.481206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:07.481490 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:07.481461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:07.481490 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:07.481492 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:07.481946 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:07.481572 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:07.481946 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:07.481656 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:08.481907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:08.481715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:08.481907 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:08.481829 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:09.481878 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:09.481845 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:09.482106 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:09.481988 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:09.482106 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:09.482029 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:09.482538 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:09.482141 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:10.097344 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:10.097310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:10.097509 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:10.097353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:10.097509 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.097471 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:54:10.097509 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.097487 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:54:10.097663 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.097537 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:54:26.09751671 +0000 UTC m=+34.165615560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:54:10.097663 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.097558 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:26.097547741 +0000 UTC m=+34.165646615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:54:10.298890 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:10.298855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:10.299043 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.299011 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:54:10.299043 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.299032 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:54:10.299043 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.299041 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:54:10.299142 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.299094 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:26.299076769 +0000 UTC m=+34.367175604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:54:10.480870 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:10.480846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:10.480992 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:10.480939 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:11.481314 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:11.481282 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:11.481314 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:11.481313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:11.481751 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:11.481401 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:11.481751 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:11.481554 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:12.482604 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:12.482573 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:12.483079 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:12.482669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:13.481519 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:13.481486 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:13.481692 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:13.481625 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:13.481692 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:13.481677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:13.481792 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:13.481763 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:14.481382 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:14.481339 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:14.481761 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:14.481481 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:14.604968 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:14.604615 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" event={"ID":"477ed5e7-278b-4ce7-9b48-bc83c1760537","Type":"ContainerStarted","Data":"c03bb4f9cd89ae3dcbc4b023fa09f615b3410b2b4933542d43d611308235f101"} Jul 14 13:54:14.611455 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:14.611426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6247h" event={"ID":"e61db8eb-06c6-4f98-a037-d431374d297b","Type":"ContainerStarted","Data":"5b85af87274c7bfe224b94e6c2d225ce2af9c0440d0ccbacbc941aade04ab0aa"} Jul 14 13:54:14.626585 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:14.626238 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-255.ec2.internal" podStartSLOduration=21.626224946 podStartE2EDuration="21.626224946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:53:57.5783329 +0000 UTC m=+5.646431756" watchObservedRunningTime="2026-07-14 13:54:14.626224946 +0000 UTC m=+22.694323800" Jul 14 13:54:14.626714 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:14.626583 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6247h" podStartSLOduration=3.6479744 podStartE2EDuration="22.626575472s" totalImagesPullingTime="18.978601072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:14.626332012 +0000 UTC m=+22.694430868" watchObservedRunningTime="2026-07-14 13:54:14.626575472 +0000 UTC m=+22.694674326" Jul 14 13:54:15.481914 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.481755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:15.482549 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.481804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:15.482549 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:15.481999 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:15.482549 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:15.482062 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:15.615004 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.614979 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" event={"ID":"114c4d8c-7ecc-4682-a684-3224e6dde0f1","Type":"ContainerStarted","Data":"147356f8e8fa66aef1564ada0eea75aeb104aab662d2c1fc1d41c809f13623e4"} Jul 14 13:54:15.616556 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.616534 2574 generic.go:356] "Generic (PLEG): container finished" podID="31b08467-f3ee-431a-843f-46949d3ea475" containerID="43bb5a14fd63c960aa4d92f12203aa7c0e4001381ea53dbbe725191a7252cf99" exitCode=0 Jul 14 13:54:15.616670 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.616609 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerDied","Data":"43bb5a14fd63c960aa4d92f12203aa7c0e4001381ea53dbbe725191a7252cf99"} Jul 14 13:54:15.618178 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.618157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7ffkp" event={"ID":"19746321-8c32-49e7-8574-c1d3bb66276f","Type":"ContainerStarted","Data":"124fd873f044fc147a88f1250733ed0cab74800c756201bb8caaf7d2e9b788f6"} Jul 14 13:54:15.619847 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.619825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwhkl" event={"ID":"566a70ee-bc1e-464d-a28d-24f051cbb7ae","Type":"ContainerStarted","Data":"6ae76d362e08ddb82cb7260d22b8321b8d05ca9d67a55e878a8b1c8e355b3b25"} Jul 14 13:54:15.621234 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.621210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hbmn" event={"ID":"c8b669d0-882d-4d49-8c63-c3cc1f064b54","Type":"ContainerStarted","Data":"b871d2acf047c21c69eba515a9022e7ccebe62f906450825001c3f840ba2f532"} Jul 14 13:54:15.623727 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.623710 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 13:54:15.624037 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624014 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff6b1518-bfce-48d2-9d31-1caf6bbe1869" containerID="90b614f2555e5257c5353dc24efb48153fcfcc539590d9230f9bae478e2425e6" exitCode=1 Jul 14 13:54:15.624123 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624084 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"d6319e2cfde162b905160bacf6de870b5a3ff1f33508ce7a797b53bac635cceb"} Jul 14 13:54:15.624250 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624150 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"943be5319d3de41d567db6af2113668e13c7b330db9ebddf682e8460095172c8"} Jul 14 13:54:15.624250 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624208 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"e08f5952bf9ce5c38cfadf98c16476e45a49e7a1873c3ac315583bba435310bf"} Jul 14 13:54:15.624250 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624245 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"37e32c1cf867e13bf32fcd2a5c18526dd8823f1cd09109e0cb5c5abed98dee83"} Jul 14 13:54:15.624403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerDied","Data":"90b614f2555e5257c5353dc24efb48153fcfcc539590d9230f9bae478e2425e6"} Jul 14 13:54:15.624403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.624314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"292bb8deba1dc96b85aade18924b0783ca4fce0ffa7c98567e2a703d655c582d"} Jul 14 13:54:15.635036 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.634999 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rd2p5" podStartSLOduration=4.632256261 podStartE2EDuration="23.634986326s" totalImagesPullingTime="19.002730065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:15.634494908 +0000 UTC m=+23.702593763" watchObservedRunningTime="2026-07-14 13:54:15.634986326 +0000 UTC m=+23.703085180" Jul 14 13:54:15.691447 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.689691 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cwhkl" podStartSLOduration=4.699645911 podStartE2EDuration="23.689673577s" totalImagesPullingTime="18.990027666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:15.652970014 +0000 UTC m=+23.721068868" watchObservedRunningTime="2026-07-14 13:54:15.689673577 +0000 UTC m=+23.757772443" Jul 14 13:54:15.725978 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.725937 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7ffkp" podStartSLOduration=4.7240250249999995 podStartE2EDuration="23.725923802s" totalImagesPullingTime="19.001898777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:15.70535145 +0000 UTC m=+23.773450304" watchObservedRunningTime="2026-07-14 13:54:15.725923802 +0000 UTC m=+23.794022657" Jul 14 13:54:15.726074 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.726025 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5hbmn" podStartSLOduration=4.695044507 podStartE2EDuration="23.726019491s" totalImagesPullingTime="19.030974984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:15.72587686 +0000 UTC m=+23.793975715" watchObservedRunningTime="2026-07-14 13:54:15.726019491 +0000 UTC m=+23.794118345" Jul 14 13:54:15.824291 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:15.824266 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 13:54:16.438582 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.438476 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T13:54:15.824284854Z","UUID":"48e4b71d-42ac-4993-85ff-170edab31c5c","Handler":null,"Name":"","Endpoint":""} Jul 14 13:54:16.439943 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.439919 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 13:54:16.440072 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.439954 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 13:54:16.481155 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.481122 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:16.481332 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:16.481248 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:16.628814 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.628778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" event={"ID":"477ed5e7-278b-4ce7-9b48-bc83c1760537","Type":"ContainerStarted","Data":"4cb204f359a6b4c83a59c4180d9ea88f0497f5e757a01870a12a71286424aa8b"} Jul 14 13:54:16.630603 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.630573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxqz6" event={"ID":"70e446f9-3f32-4e43-bc8b-4fc7b9a7918d","Type":"ContainerStarted","Data":"65894b53b573250ea3aae9b1b9eed6adb7aff88fd4a9a29448cd07e5fdc26d1f"} Jul 14 13:54:16.646565 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:16.646515 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dxqz6" podStartSLOduration=5.651438313 podStartE2EDuration="24.64649668s" totalImagesPullingTime="18.995058367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:16.646256146 +0000 UTC m=+24.714355000" watchObservedRunningTime="2026-07-14 13:54:16.64649668 +0000 UTC m=+24.714595533" Jul 14 13:54:17.481435 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:17.481233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:17.481559 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:17.481278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:17.481559 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:17.481534 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:17.481689 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:17.481667 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:17.635516 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:17.635477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" event={"ID":"477ed5e7-278b-4ce7-9b48-bc83c1760537","Type":"ContainerStarted","Data":"ea27678ceeadf52ef20eba3060b454b03481dc6506448c533a83b41b0d7ec88d"} Jul 14 13:54:17.654691 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:17.654603 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pjjrh" podStartSLOduration=7.932629937 podStartE2EDuration="25.654586852s" totalImagesPullingTime="17.721956915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:17.653883886 +0000 UTC m=+25.721982740" watchObservedRunningTime="2026-07-14 13:54:17.654586852 +0000 UTC m=+25.722685710" Jul 14 13:54:18.481072 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:18.481041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:18.481256 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:18.481159 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:18.641405 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:18.641377 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 13:54:18.642040 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:18.641827 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"d56170672467ac8dba9f79441f2f995a98997b6b1792c8a6d78b96ee46d0ef4e"} Jul 14 13:54:19.049059 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:19.049023 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:54:19.049687 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:19.049666 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:54:19.481014 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:19.480981 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:19.481213 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:19.480982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:19.481213 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:19.481115 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:19.481342 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:19.481206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:19.643583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:19.643548 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:54:19.644070 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:19.644053 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cwhkl" Jul 14 13:54:20.482017 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:20.481844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:20.482239 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:20.482079 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:20.649422 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:20.649392 2574 generic.go:356] "Generic (PLEG): container finished" podID="31b08467-f3ee-431a-843f-46949d3ea475" containerID="bddf8233b2a9052fa5dd33943896253f6f5c090386ab4ad59aae0d5625ed3578" exitCode=0 Jul 14 13:54:20.649930 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:20.649470 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerDied","Data":"bddf8233b2a9052fa5dd33943896253f6f5c090386ab4ad59aae0d5625ed3578"} Jul 14 13:54:20.652869 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:20.652852 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 13:54:20.653239 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:20.653216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"17777e6088ea2ceb2e2a901e8c41c29040df8a784ca3c6542f36933900bd5fc1"} Jul 14 13:54:20.653712 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:20.653694 2574 scope.go:117] "RemoveContainer" containerID="90b614f2555e5257c5353dc24efb48153fcfcc539590d9230f9bae478e2425e6" Jul 14 13:54:21.480864 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.480797 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:21.481123 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:21.480922 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:21.481123 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.480977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:21.481123 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:21.481097 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:21.660298 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.660273 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 13:54:21.660985 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.660733 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" event={"ID":"ff6b1518-bfce-48d2-9d31-1caf6bbe1869","Type":"ContainerStarted","Data":"fe256633b4502e7a15bebf0f5e87e463f60296d4a99cfffe0ead47cd54c1eb11"} Jul 14 13:54:21.661072 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.661025 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:54:21.661125 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.661100 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:54:21.661176 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.661150 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:54:21.675452 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.675432 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:54:21.675572 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.675518 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:54:21.693453 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.693406 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" podStartSLOduration=10.393526701 podStartE2EDuration="29.693388553s" totalImagesPullingTime="19.299861852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:21.691820279 +0000 UTC m=+29.759919133" watchObservedRunningTime="2026-07-14 13:54:21.693388553 +0000 UTC m=+29.761487410" Jul 14 13:54:21.883091 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.882921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4c9nv"] Jul 14 13:54:21.883292 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.883250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:21.883384 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:21.883364 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:21.883489 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.883470 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb2bw"] Jul 14 13:54:21.883571 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.883559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:21.883665 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:21.883644 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:21.883942 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.883915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rkj9w"] Jul 14 13:54:21.884038 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:21.884024 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:21.884163 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:21.884146 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:22.664310 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:22.664277 2574 generic.go:356] "Generic (PLEG): container finished" podID="31b08467-f3ee-431a-843f-46949d3ea475" containerID="fdef319968500dc521c54a18fff41a65c6e53dcbbd7b9b96ec6ffc1b432f7aad" exitCode=0 Jul 14 13:54:22.664783 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:22.664374 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerDied","Data":"fdef319968500dc521c54a18fff41a65c6e53dcbbd7b9b96ec6ffc1b432f7aad"} Jul 14 13:54:23.481059 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:23.481032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:23.481288 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:23.481119 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:23.481288 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:23.481147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:23.481288 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:23.481212 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:23.481416 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:23.481292 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:23.481416 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:23.481359 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:24.670748 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:24.670699 2574 generic.go:356] "Generic (PLEG): container finished" podID="31b08467-f3ee-431a-843f-46949d3ea475" containerID="1e92e0dfada81502703164aeb88863e779a151a14e2ea79f8c60cd8190cb7071" exitCode=0 Jul 14 13:54:24.671356 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:24.670755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerDied","Data":"1e92e0dfada81502703164aeb88863e779a151a14e2ea79f8c60cd8190cb7071"} Jul 14 13:54:25.481101 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:25.481070 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:25.481289 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:25.481075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:25.481289 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:25.481202 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:25.481389 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:25.481299 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:25.481389 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:25.481079 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:25.481465 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:25.481392 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:26.113201 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:26.113158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:26.113793 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:26.113214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:26.113793 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.113308 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:54:26.113793 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.113383 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs podName:e9061185-b7c8-44eb-b1fc-1103dbe70ef0 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:58.113361156 +0000 UTC m=+66.181460001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs") pod "network-metrics-daemon-rkj9w" (UID: "e9061185-b7c8-44eb-b1fc-1103dbe70ef0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 13:54:26.113793 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.113306 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 13:54:26.113793 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.113449 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret podName:a1b6fb18-b4c3-4f89-b300-668bedc1d7ee nodeName:}" failed. No retries permitted until 2026-07-14 13:54:58.113435944 +0000 UTC m=+66.181534781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret") pod "global-pull-secret-syncer-4c9nv" (UID: "a1b6fb18-b4c3-4f89-b300-668bedc1d7ee") : object "kube-system"/"original-pull-secret" not registered Jul 14 13:54:26.315147 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:26.315105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:26.315318 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.315302 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 13:54:26.315362 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.315321 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 13:54:26.315362 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.315334 2574 projected.go:196] Error preparing data for projected volume kube-api-access-n7qvw for pod openshift-network-diagnostics/network-check-target-zb2bw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:54:26.315432 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:26.315380 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw podName:844cc775-e693-42c0-958b-044583a4bce3 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:58.315367766 +0000 UTC m=+66.383466602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7qvw" (UniqueName: "kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw") pod "network-check-target-zb2bw" (UID: "844cc775-e693-42c0-958b-044583a4bce3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 13:54:27.481171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:27.481108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:27.481602 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:27.481111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:27.481602 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:27.481279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:27.481602 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:27.481296 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rkj9w" podUID="e9061185-b7c8-44eb-b1fc-1103dbe70ef0" Jul 14 13:54:27.481602 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:27.481378 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb2bw" podUID="844cc775-e693-42c0-958b-044583a4bce3" Jul 14 13:54:27.481602 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:27.481474 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9nv" podUID="a1b6fb18-b4c3-4f89-b300-668bedc1d7ee" Jul 14 13:54:28.214617 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.214587 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-255.ec2.internal" event="NodeReady" Jul 14 13:54:28.214803 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.214745 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 13:54:28.253096 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.253026 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66d9d8bff8-7hj84"] Jul 14 13:54:28.256238 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.256217 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.258999 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.258974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 13:54:28.259319 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.259300 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 13:54:28.259787 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.259645 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 13:54:28.259787 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.259774 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d4hld\"" Jul 14 13:54:28.266767 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.266735 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 13:54:28.268610 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.268572 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth"] Jul 14 13:54:28.270767 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.270749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" Jul 14 13:54:28.275152 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.274991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.275152 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.275132 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.277793 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.275870 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qjgrx\"" Jul 14 13:54:28.277793 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.276046 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q"] Jul 14 13:54:28.279748 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.279726 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7"] Jul 14 13:54:28.279882 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.279865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.282418 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.282394 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.282514 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.282497 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 13:54:28.282579 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.282526 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d9d8bff8-7hj84"] Jul 14 13:54:28.282579 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.282559 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd"] Jul 14 13:54:28.282767 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.282749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:28.283208 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.283177 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hxhlm\"" Jul 14 13:54:28.283327 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.283306 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.283426 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.283410 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 13:54:28.286386 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.285852 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.286386 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.285897 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-gv99t"] Jul 14 13:54:28.286386 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.286038 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.286386 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.286107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4ngzp\"" Jul 14 13:54:28.286639 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.286618 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 13:54:28.288775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.286760 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.290384 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.289456 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-l9htw"] Jul 14 13:54:28.290384 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.290339 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.291396 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.291377 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.291567 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.291539 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 13:54:28.291935 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.291733 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-svlt7\"" Jul 14 13:54:28.291935 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.291533 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 13:54:28.292102 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.291978 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.295865 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.294466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 13:54:28.295865 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.294630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 13:54:28.295865 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.294928 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-knkdq\"" Jul 14 13:54:28.296984 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.296961 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.298215 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.297559 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth"] Jul 14 13:54:28.298215 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.297599 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q"] Jul 14 13:54:28.298215 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.297621 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7"] Jul 14 13:54:28.298215 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.297705 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.298667 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.298649 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.299009 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.298914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd"] Jul 14 13:54:28.300142 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.300061 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86c6b64644-bzmkz"] Jul 14 13:54:28.301966 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.301947 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.302396 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.302367 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.302831 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.302811 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-txcjr\"" Jul 14 13:54:28.303229 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.303212 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wpqwk"] Jul 14 13:54:28.303492 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.303474 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 13:54:28.303570 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.303518 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 13:54:28.303570 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.303530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.305519 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.305501 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 13:54:28.307338 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.307312 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf"] Jul 14 13:54:28.307446 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.307430 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.309325 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.309308 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 13:54:28.310132 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.309935 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n"] Jul 14 13:54:28.310132 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.309955 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 13:54:28.310132 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.309974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rvh4f\"" Jul 14 13:54:28.310132 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.309987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 13:54:28.310410 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.310331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.310722 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.310699 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.311000 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.310982 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 13:54:28.311595 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.311571 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.311595 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.311588 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jdhdm\"" Jul 14 13:54:28.312609 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.312072 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 13:54:28.312609 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.312257 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 13:54:28.312609 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.312550 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.313255 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.313112 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.313380 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.313267 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.314725 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.314701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gv99t"] Jul 14 13:54:28.314918 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.314903 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-l9htw"] Jul 14 13:54:28.315294 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.315279 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wpqwk"] Jul 14 13:54:28.315450 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.315162 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lmk28\"" Jul 14 13:54:28.316591 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.315176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" Jul 14 13:54:28.317383 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.315106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.317383 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.315652 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 13:54:28.317383 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.316469 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 13:54:28.319483 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.319465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n"] Jul 14 13:54:28.321397 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.321370 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86c6b64644-bzmkz"] Jul 14 13:54:28.322484 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.321539 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 13:54:28.322813 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.321658 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 13:54:28.322949 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.321689 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4jrkd\"" Jul 14 13:54:28.326109 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.326084 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf"] Jul 14 13:54:28.373591 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.373567 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qr87g"] Jul 14 13:54:28.376618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.376599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.379487 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.379466 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 13:54:28.379598 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.379491 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mh5f9\"" Jul 14 13:54:28.379912 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.379734 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 13:54:28.396263 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.396241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qr87g"] Jul 14 13:54:28.431159 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-bound-sa-token\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.431298 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.431298 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pz6c\" (UniqueName: \"kubernetes.io/projected/0a91cba6-73c0-4713-a83a-c57abdfbb80e-kube-api-access-7pz6c\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.431298 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgdv\" (UniqueName: \"kubernetes.io/projected/542c2330-fd10-415c-8337-ec72bded2841-kube-api-access-bhgdv\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:28.431448 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-certificates\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.431448 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-trusted-ca\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.431448 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hgh5\" (UniqueName: \"kubernetes.io/projected/e2ed97dc-eae1-4d05-9f84-96324bdf52eb-kube-api-access-4hgh5\") pod \"ingress-canary-wpqwk\" (UID: \"e2ed97dc-eae1-4d05-9f84-96324bdf52eb\") " pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.431448 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a91cba6-73c0-4713-a83a-c57abdfbb80e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.431583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b3aa349-a588-4e4c-978b-0c5b0aa27216-serving-cert\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.431583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-image-registry-private-configuration\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.431583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ed97dc-eae1-4d05-9f84-96324bdf52eb-cert\") pod \"ingress-canary-wpqwk\" (UID: \"e2ed97dc-eae1-4d05-9f84-96324bdf52eb\") " pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.431583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.431583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9bg\" (UniqueName: \"kubernetes.io/projected/366945c0-3ffb-4b1d-9b27-0947917bf6d7-kube-api-access-kj9bg\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.431583 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a91cba6-73c0-4713-a83a-c57abdfbb80e-config\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3aa349-a588-4e4c-978b-0c5b0aa27216-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df04271c-2cc2-4129-a11c-76d256b11939-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-stats-auth\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3aa349-a588-4e4c-978b-0c5b0aa27216-tmp\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/366945c0-3ffb-4b1d-9b27-0947917bf6d7-config\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnss\" (UniqueName: \"kubernetes.io/projected/df04271c-2cc2-4129-a11c-76d256b11939-kube-api-access-9mnss\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.431794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431795 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5hg\" (UniqueName: \"kubernetes.io/projected/a0d5223f-ddc7-4282-af3a-0eea59351161-kube-api-access-ck5hg\") pod \"network-check-source-869dcfcdcd-qgx9n\" (UID: \"a0d5223f-ddc7-4282-af3a-0eea59351161\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/366945c0-3ffb-4b1d-9b27-0947917bf6d7-serving-cert\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/366945c0-3ffb-4b1d-9b27-0947917bf6d7-trusted-ca\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b3aa349-a588-4e4c-978b-0c5b0aa27216-snapshots\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-installation-pull-secrets\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56j87\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-kube-api-access-56j87\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.431986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czltc\" (UniqueName: \"kubernetes.io/projected/8c1b1ab5-8f44-487f-9769-abe4242c7622-kube-api-access-czltc\") pod \"volume-data-source-validator-78495597f6-2sgth\" (UID: \"8c1b1ab5-8f44-487f-9769-abe4242c7622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-default-certificate\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdw4\" (UniqueName: \"kubernetes.io/projected/baabe0fd-609f-4826-b7df-f08652ac60ab-kube-api-access-8kdw4\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3aa349-a588-4e4c-978b-0c5b0aa27216-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srcpx\" (UniqueName: \"kubernetes.io/projected/3b3aa349-a588-4e4c-978b-0c5b0aa27216-kube-api-access-srcpx\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.432207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df04271c-2cc2-4129-a11c-76d256b11939-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.432709 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.432709 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d79bd89e-e708-485a-9fef-fd373f5a87f8-ca-trust-extracted\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.432709 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.432274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qrhc\" (UniqueName: \"kubernetes.io/projected/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-kube-api-access-5qrhc\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.532785 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srcpx\" (UniqueName: \"kubernetes.io/projected/3b3aa349-a588-4e4c-978b-0c5b0aa27216-kube-api-access-srcpx\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.532785 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df04271c-2cc2-4129-a11c-76d256b11939-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d79bd89e-e708-485a-9fef-fd373f5a87f8-ca-trust-extracted\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qrhc\" (UniqueName: \"kubernetes.io/projected/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-kube-api-access-5qrhc\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-bound-sa-token\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pz6c\" (UniqueName: \"kubernetes.io/projected/0a91cba6-73c0-4713-a83a-c57abdfbb80e-kube-api-access-7pz6c\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgdv\" (UniqueName: \"kubernetes.io/projected/542c2330-fd10-415c-8337-ec72bded2841-kube-api-access-bhgdv\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.532966 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.532975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-certificates\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.532985 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d9d8bff8-7hj84: secret "image-registry-tls" not found Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-trusted-ca\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hgh5\" (UniqueName: \"kubernetes.io/projected/e2ed97dc-eae1-4d05-9f84-96324bdf52eb-kube-api-access-4hgh5\") pod \"ingress-canary-wpqwk\" (UID: \"e2ed97dc-eae1-4d05-9f84-96324bdf52eb\") " pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.533052 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls podName:d79bd89e-e708-485a-9fef-fd373f5a87f8 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:29.03303119 +0000 UTC m=+37.101130024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls") pod "image-registry-66d9d8bff8-7hj84" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8") : secret "image-registry-tls" not found Jul 14 13:54:28.533907 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.533057 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a91cba6-73c0-4713-a83a-c57abdfbb80e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.533120 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls podName:bc1ba704-85c2-4ed5-80f2-ed62c9f02272 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:29.033104394 +0000 UTC m=+37.101203255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bcmrf" (UID: "bc1ba704-85c2-4ed5-80f2-ed62c9f02272") : secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b3aa349-a588-4e4c-978b-0c5b0aa27216-serving-cert\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533224 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-image-registry-private-configuration\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533244 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d79bd89e-e708-485a-9fef-fd373f5a87f8-ca-trust-extracted\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2f38ab-d834-4650-abf5-d0ca199c0da4-tmp-dir\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ed97dc-eae1-4d05-9f84-96324bdf52eb-cert\") pod \"ingress-canary-wpqwk\" (UID: \"e2ed97dc-eae1-4d05-9f84-96324bdf52eb\") " pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.533490 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:29.033473923 +0000 UTC m=+37.101572771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : configmap references non-existent config key: service-ca.crt Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9bg\" (UniqueName: \"kubernetes.io/projected/366945c0-3ffb-4b1d-9b27-0947917bf6d7-kube-api-access-kj9bg\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.534488 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a91cba6-73c0-4713-a83a-c57abdfbb80e-config\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2f38ab-d834-4650-abf5-d0ca199c0da4-config-volume\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nbdl\" (UniqueName: \"kubernetes.io/projected/4e2f38ab-d834-4650-abf5-d0ca199c0da4-kube-api-access-9nbdl\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533731 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-certificates\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533763 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3aa349-a588-4e4c-978b-0c5b0aa27216-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.533819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df04271c-2cc2-4129-a11c-76d256b11939-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534115 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-trusted-ca\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a91cba6-73c0-4713-a83a-c57abdfbb80e-config\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-stats-auth\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3aa349-a588-4e4c-978b-0c5b0aa27216-tmp\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/366945c0-3ffb-4b1d-9b27-0947917bf6d7-config\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnss\" (UniqueName: \"kubernetes.io/projected/df04271c-2cc2-4129-a11c-76d256b11939-kube-api-access-9mnss\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.534995 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534441 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df04271c-2cc2-4129-a11c-76d256b11939-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5hg\" (UniqueName: \"kubernetes.io/projected/a0d5223f-ddc7-4282-af3a-0eea59351161-kube-api-access-ck5hg\") pod \"network-check-source-869dcfcdcd-qgx9n\" (UID: \"a0d5223f-ddc7-4282-af3a-0eea59351161\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.534652 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.534694 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls podName:542c2330-fd10-415c-8337-ec72bded2841 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:29.034681642 +0000 UTC m=+37.102780490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls") pod "cluster-samples-operator-65db858894-v48n7" (UID: "542c2330-fd10-415c-8337-ec72bded2841") : secret "samples-operator-tls" not found Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/366945c0-3ffb-4b1d-9b27-0947917bf6d7-serving-cert\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/366945c0-3ffb-4b1d-9b27-0947917bf6d7-trusted-ca\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b3aa349-a588-4e4c-978b-0c5b0aa27216-snapshots\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534826 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3aa349-a588-4e4c-978b-0c5b0aa27216-tmp\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-installation-pull-secrets\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56j87\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-kube-api-access-56j87\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czltc\" (UniqueName: \"kubernetes.io/projected/8c1b1ab5-8f44-487f-9769-abe4242c7622-kube-api-access-czltc\") pod \"volume-data-source-validator-78495597f6-2sgth\" (UID: \"8c1b1ab5-8f44-487f-9769-abe4242c7622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-default-certificate\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.535592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.536345 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdw4\" (UniqueName: \"kubernetes.io/projected/baabe0fd-609f-4826-b7df-f08652ac60ab-kube-api-access-8kdw4\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.536345 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.534996 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3aa349-a588-4e4c-978b-0c5b0aa27216-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.536345 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.535019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3aa349-a588-4e4c-978b-0c5b0aa27216-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.536345 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.535905 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3aa349-a588-4e4c-978b-0c5b0aa27216-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.536345 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.535923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/366945c0-3ffb-4b1d-9b27-0947917bf6d7-config\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.537280 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.536683 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 13:54:28.537280 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.536739 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:29.036725004 +0000 UTC m=+37.104823851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : secret "router-metrics-certs-default" not found Jul 14 13:54:28.537280 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.536811 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/366945c0-3ffb-4b1d-9b27-0947917bf6d7-trusted-ca\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.537280 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.537030 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.537280 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.537228 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b3aa349-a588-4e4c-978b-0c5b0aa27216-snapshots\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.538681 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.538657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:28.538962 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.538935 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ed97dc-eae1-4d05-9f84-96324bdf52eb-cert\") pod \"ingress-canary-wpqwk\" (UID: \"e2ed97dc-eae1-4d05-9f84-96324bdf52eb\") " pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.539592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.539297 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-installation-pull-secrets\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.539592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.539370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df04271c-2cc2-4129-a11c-76d256b11939-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.539592 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.539524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a91cba6-73c0-4713-a83a-c57abdfbb80e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.539806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.539687 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b3aa349-a588-4e4c-978b-0c5b0aa27216-serving-cert\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.539872 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.539850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/366945c0-3ffb-4b1d-9b27-0947917bf6d7-serving-cert\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.540076 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.540050 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-image-registry-private-configuration\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.540970 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.540939 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-stats-auth\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.541778 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.541735 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-default-certificate\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.543967 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.543692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pz6c\" (UniqueName: \"kubernetes.io/projected/0a91cba6-73c0-4713-a83a-c57abdfbb80e-kube-api-access-7pz6c\") pod \"service-ca-operator-7695fc6c8c-6d9gd\" (UID: \"0a91cba6-73c0-4713-a83a-c57abdfbb80e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.544748 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.544727 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srcpx\" (UniqueName: \"kubernetes.io/projected/3b3aa349-a588-4e4c-978b-0c5b0aa27216-kube-api-access-srcpx\") pod \"insights-operator-68d9dd94cf-l9htw\" (UID: \"3b3aa349-a588-4e4c-978b-0c5b0aa27216\") " pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.546057 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.545329 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qrhc\" (UniqueName: \"kubernetes.io/projected/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-kube-api-access-5qrhc\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:28.546697 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.546491 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hgh5\" (UniqueName: \"kubernetes.io/projected/e2ed97dc-eae1-4d05-9f84-96324bdf52eb-kube-api-access-4hgh5\") pod \"ingress-canary-wpqwk\" (UID: \"e2ed97dc-eae1-4d05-9f84-96324bdf52eb\") " pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.551544 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.550553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56j87\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-kube-api-access-56j87\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.552396 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.552374 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnss\" (UniqueName: \"kubernetes.io/projected/df04271c-2cc2-4129-a11c-76d256b11939-kube-api-access-9mnss\") pod \"kube-storage-version-migrator-operator-799cb7f958-cnd8q\" (UID: \"df04271c-2cc2-4129-a11c-76d256b11939\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.552584 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.552538 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgdv\" (UniqueName: \"kubernetes.io/projected/542c2330-fd10-415c-8337-ec72bded2841-kube-api-access-bhgdv\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:28.553422 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.553368 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czltc\" (UniqueName: \"kubernetes.io/projected/8c1b1ab5-8f44-487f-9769-abe4242c7622-kube-api-access-czltc\") pod \"volume-data-source-validator-78495597f6-2sgth\" (UID: \"8c1b1ab5-8f44-487f-9769-abe4242c7622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" Jul 14 13:54:28.553703 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.553651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdw4\" (UniqueName: \"kubernetes.io/projected/baabe0fd-609f-4826-b7df-f08652ac60ab-kube-api-access-8kdw4\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:28.553871 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.553850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9bg\" (UniqueName: \"kubernetes.io/projected/366945c0-3ffb-4b1d-9b27-0947917bf6d7-kube-api-access-kj9bg\") pod \"console-operator-7866497494-gv99t\" (UID: \"366945c0-3ffb-4b1d-9b27-0947917bf6d7\") " pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.553943 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.553889 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-bound-sa-token\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:28.554558 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.554536 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5hg\" (UniqueName: \"kubernetes.io/projected/a0d5223f-ddc7-4282-af3a-0eea59351161-kube-api-access-ck5hg\") pod \"network-check-source-869dcfcdcd-qgx9n\" (UID: \"a0d5223f-ddc7-4282-af3a-0eea59351161\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" Jul 14 13:54:28.582291 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.582263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" Jul 14 13:54:28.598519 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.598497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" Jul 14 13:54:28.617314 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.617250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" Jul 14 13:54:28.625453 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.625428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:28.633036 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.633019 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" Jul 14 13:54:28.635069 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.635046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:28.635396 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.635376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2f38ab-d834-4650-abf5-d0ca199c0da4-tmp-dir\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.635479 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.635430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2f38ab-d834-4650-abf5-d0ca199c0da4-config-volume\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.635479 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.635451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nbdl\" (UniqueName: \"kubernetes.io/projected/4e2f38ab-d834-4650-abf5-d0ca199c0da4-kube-api-access-9nbdl\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.635573 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.635493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.635717 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.635680 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 13:54:28.635717 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.635698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2f38ab-d834-4650-abf5-d0ca199c0da4-tmp-dir\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.635815 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:28.635762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls podName:4e2f38ab-d834-4650-abf5-d0ca199c0da4 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:29.135742618 +0000 UTC m=+37.203841470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls") pod "dns-default-qr87g" (UID: "4e2f38ab-d834-4650-abf5-d0ca199c0da4") : secret "dns-default-metrics-tls" not found Jul 14 13:54:28.636033 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.636009 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2f38ab-d834-4650-abf5-d0ca199c0da4-config-volume\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.644556 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.644532 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nbdl\" (UniqueName: \"kubernetes.io/projected/4e2f38ab-d834-4650-abf5-d0ca199c0da4-kube-api-access-9nbdl\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:28.645361 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.645341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wpqwk" Jul 14 13:54:28.658624 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:28.658607 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.039145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.039230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.039272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.039330 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039346 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.039360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039418 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls podName:bc1ba704-85c2-4ed5-80f2-ed62c9f02272 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:30.039398376 +0000 UTC m=+38.107497220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bcmrf" (UID: "bc1ba704-85c2-4ed5-80f2-ed62c9f02272") : secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039456 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039468 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d9d8bff8-7hj84: secret "image-registry-tls" not found Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039483 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039503 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls podName:d79bd89e-e708-485a-9fef-fd373f5a87f8 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:30.039490698 +0000 UTC m=+38.107589551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls") pod "image-registry-66d9d8bff8-7hj84" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8") : secret "image-registry-tls" not found Jul 14 13:54:29.039616 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039517 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls podName:542c2330-fd10-415c-8337-ec72bded2841 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:30.039509332 +0000 UTC m=+38.107608166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls") pod "cluster-samples-operator-65db858894-v48n7" (UID: "542c2330-fd10-415c-8337-ec72bded2841") : secret "samples-operator-tls" not found Jul 14 13:54:29.040325 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039558 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:30.039548295 +0000 UTC m=+38.107647134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : configmap references non-existent config key: service-ca.crt Jul 14 13:54:29.040325 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039567 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 13:54:29.040325 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.039600 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:30.039591655 +0000 UTC m=+38.107690517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : secret "router-metrics-certs-default" not found Jul 14 13:54:29.141943 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.141042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:29.141943 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.141312 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 13:54:29.141943 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:29.141382 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls podName:4e2f38ab-d834-4650-abf5-d0ca199c0da4 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:30.141361542 +0000 UTC m=+38.209460379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls") pod "dns-default-qr87g" (UID: "4e2f38ab-d834-4650-abf5-d0ca199c0da4") : secret "dns-default-metrics-tls" not found Jul 14 13:54:29.237503 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.237465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wpqwk"] Jul 14 13:54:29.243439 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:29.243410 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ed97dc_eae1_4d05_9f84_96324bdf52eb.slice/crio-c6f9a29113243980fea338422db3a608f3cef1724bf9a1c794e25822e39de2c3 WatchSource:0}: Error finding container c6f9a29113243980fea338422db3a608f3cef1724bf9a1c794e25822e39de2c3: Status 404 returned error can't find the container with id c6f9a29113243980fea338422db3a608f3cef1724bf9a1c794e25822e39de2c3 Jul 14 13:54:29.253071 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.252925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gv99t"] Jul 14 13:54:29.257281 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.257258 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n"] Jul 14 13:54:29.258617 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.258151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth"] Jul 14 13:54:29.259079 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.259057 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd"] Jul 14 13:54:29.265099 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.265080 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-l9htw"] Jul 14 13:54:29.271115 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.271090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q"] Jul 14 13:54:29.274945 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:29.274917 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1b1ab5_8f44_487f_9769_abe4242c7622.slice/crio-b39843ded9c53c1d98bf266e3cfd9bef19feef64be04f1387b2a3c0f7fc3b8a2 WatchSource:0}: Error finding container b39843ded9c53c1d98bf266e3cfd9bef19feef64be04f1387b2a3c0f7fc3b8a2: Status 404 returned error can't find the container with id b39843ded9c53c1d98bf266e3cfd9bef19feef64be04f1387b2a3c0f7fc3b8a2 Jul 14 13:54:29.480885 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.480833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:29.480885 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.480854 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:29.481084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.481058 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:29.483437 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.483403 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 13:54:29.483529 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.483414 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 13:54:29.483529 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.483481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7c4p6\"" Jul 14 13:54:29.483652 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.483554 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v5knd\"" Jul 14 13:54:29.684253 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.684221 2574 generic.go:356] "Generic (PLEG): container finished" podID="31b08467-f3ee-431a-843f-46949d3ea475" containerID="7ff402f7a75c89faf14342abee479a2ce162298ee5b204b94b3b19755e52bdeb" exitCode=0 Jul 14 13:54:29.684704 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.684307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerDied","Data":"7ff402f7a75c89faf14342abee479a2ce162298ee5b204b94b3b19755e52bdeb"} Jul 14 13:54:29.685439 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.685414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gv99t" event={"ID":"366945c0-3ffb-4b1d-9b27-0947917bf6d7","Type":"ContainerStarted","Data":"1f5848d1978afee61fde3653e2015d81edbfd456fe5fcf9f1179d038359e1d70"} Jul 14 13:54:29.686549 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.686527 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" event={"ID":"df04271c-2cc2-4129-a11c-76d256b11939","Type":"ContainerStarted","Data":"5d3d23bdbe3f06df378dc7418e59a3942197e57000121bd8225442465dfa4f74"} Jul 14 13:54:29.687601 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.687581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" event={"ID":"a0d5223f-ddc7-4282-af3a-0eea59351161","Type":"ContainerStarted","Data":"9d6c765bbefcd4a48168cff7469c38d1c74870abbbe65c113751379bf32dad59"} Jul 14 13:54:29.688611 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.688593 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wpqwk" event={"ID":"e2ed97dc-eae1-4d05-9f84-96324bdf52eb","Type":"ContainerStarted","Data":"c6f9a29113243980fea338422db3a608f3cef1724bf9a1c794e25822e39de2c3"} Jul 14 13:54:29.689771 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.689750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" event={"ID":"8c1b1ab5-8f44-487f-9769-abe4242c7622","Type":"ContainerStarted","Data":"b39843ded9c53c1d98bf266e3cfd9bef19feef64be04f1387b2a3c0f7fc3b8a2"} Jul 14 13:54:29.690785 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.690768 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" event={"ID":"0a91cba6-73c0-4713-a83a-c57abdfbb80e","Type":"ContainerStarted","Data":"e2eab1d3fd875004c1780d08343667331e4c55f749643f92b47fec2bd656f536"} Jul 14 13:54:29.691793 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:29.691775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" event={"ID":"3b3aa349-a588-4e4c-978b-0c5b0aa27216","Type":"ContainerStarted","Data":"d21d84272799304119fdfc53d490b6960b588a9f9c78787772677cf921235e0a"} Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.049788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.049849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.049914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.049949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.049988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050130 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050207 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls podName:bc1ba704-85c2-4ed5-80f2-ed62c9f02272 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:32.050172632 +0000 UTC m=+40.118271471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bcmrf" (UID: "bc1ba704-85c2-4ed5-80f2-ed62c9f02272") : secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050410 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050456 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:32.050441538 +0000 UTC m=+40.118540378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : secret "router-metrics-certs-default" not found Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050522 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:32.050511349 +0000 UTC m=+40.118610188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : configmap references non-existent config key: service-ca.crt Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050585 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050620 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls podName:542c2330-fd10-415c-8337-ec72bded2841 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:32.050608861 +0000 UTC m=+40.118707707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls") pod "cluster-samples-operator-65db858894-v48n7" (UID: "542c2330-fd10-415c-8337-ec72bded2841") : secret "samples-operator-tls" not found Jul 14 13:54:30.051500 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050676 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 13:54:30.052237 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050689 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d9d8bff8-7hj84: secret "image-registry-tls" not found Jul 14 13:54:30.052237 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.050746 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls podName:d79bd89e-e708-485a-9fef-fd373f5a87f8 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:32.050734683 +0000 UTC m=+40.118833520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls") pod "image-registry-66d9d8bff8-7hj84" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8") : secret "image-registry-tls" not found Jul 14 13:54:30.150775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.150736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:30.151451 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.151004 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 13:54:30.151451 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:30.151067 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls podName:4e2f38ab-d834-4650-abf5-d0ca199c0da4 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:32.151049873 +0000 UTC m=+40.219148707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls") pod "dns-default-qr87g" (UID: "4e2f38ab-d834-4650-abf5-d0ca199c0da4") : secret "dns-default-metrics-tls" not found Jul 14 13:54:30.486509 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.486459 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:30.555443 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.555410 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:30.712209 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.711304 2574 generic.go:356] "Generic (PLEG): container finished" podID="31b08467-f3ee-431a-843f-46949d3ea475" containerID="609a33a1f50ab51b960730a016e4b74e25fd433fa87aafacf33a823efc4e9185" exitCode=0 Jul 14 13:54:30.712209 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:30.711387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerDied","Data":"609a33a1f50ab51b960730a016e4b74e25fd433fa87aafacf33a823efc4e9185"} Jul 14 13:54:31.717911 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:31.717632 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" event={"ID":"8c1b1ab5-8f44-487f-9769-abe4242c7622","Type":"ContainerStarted","Data":"5c3d10f5132ad82899e6ffc1d5e37dd5c02167ac8e125a76c5bae50b56b5c08a"} Jul 14 13:54:31.729176 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:31.728607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khhn7" event={"ID":"31b08467-f3ee-431a-843f-46949d3ea475","Type":"ContainerStarted","Data":"6f3826f70716cffd9a6aac93566ece1a95e76611fa61e9c439f3b72aa322c8a5"} Jul 14 13:54:31.741251 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:31.741087 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2sgth" podStartSLOduration=7.947951277 podStartE2EDuration="9.741067685s" totalImagesPullingTime="1.793116408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:31.739105223 +0000 UTC m=+39.807204079" watchObservedRunningTime="2026-07-14 13:54:31.741067685 +0000 UTC m=+39.809166541" Jul 14 13:54:31.767859 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:31.766926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-khhn7" podStartSLOduration=10.223265674 podStartE2EDuration="39.766913242s" totalImagesPullingTime="29.543647568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:31.764977766 +0000 UTC m=+39.833076650" watchObservedRunningTime="2026-07-14 13:54:31.766913242 +0000 UTC m=+39.835012097" Jul 14 13:54:31.903128 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:31.903052 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:32.014641 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.014521 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.069485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.069541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.069604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.069638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.069674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069740 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069760 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069796 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:36.069772775 +0000 UTC m=+44.137871612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : configmap references non-existent config key: service-ca.crt Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069809 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069810 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069834 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d9d8bff8-7hj84: secret "image-registry-tls" not found Jul 14 13:54:32.069856 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069823 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls podName:542c2330-fd10-415c-8337-ec72bded2841 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:36.069812487 +0000 UTC m=+44.137911324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls") pod "cluster-samples-operator-65db858894-v48n7" (UID: "542c2330-fd10-415c-8337-ec72bded2841") : secret "samples-operator-tls" not found Jul 14 13:54:32.070559 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069892 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:36.069876772 +0000 UTC m=+44.137975611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : secret "router-metrics-certs-default" not found Jul 14 13:54:32.070559 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069908 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls podName:bc1ba704-85c2-4ed5-80f2-ed62c9f02272 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:36.069898915 +0000 UTC m=+44.137997751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bcmrf" (UID: "bc1ba704-85c2-4ed5-80f2-ed62c9f02272") : secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:32.070559 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.069923 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls podName:d79bd89e-e708-485a-9fef-fd373f5a87f8 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:36.069915583 +0000 UTC m=+44.138014422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls") pod "image-registry-66d9d8bff8-7hj84" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8") : secret "image-registry-tls" not found Jul 14 13:54:32.105915 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.105880 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:32.170337 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.170308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:32.170503 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.170481 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 13:54:32.170567 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:32.170559 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls podName:4e2f38ab-d834-4650-abf5-d0ca199c0da4 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:36.170537635 +0000 UTC m=+44.238636471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls") pod "dns-default-qr87g" (UID: "4e2f38ab-d834-4650-abf5-d0ca199c0da4") : secret "dns-default-metrics-tls" not found Jul 14 13:54:32.203100 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.202868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:32.337689 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.337618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:32.444023 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:32.443990 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" limit=1024 Jul 14 13:54:36.102831 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:36.102777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:36.102849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:36.102902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:36.102925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.102974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:44.102948389 +0000 UTC m=+52.171047243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : configmap references non-existent config key: service-ca.crt Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103004 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:36.103011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103019 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103046 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d9d8bff8-7hj84: secret "image-registry-tls" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103072 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103047 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls podName:542c2330-fd10-415c-8337-ec72bded2841 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:44.103035536 +0000 UTC m=+52.171134388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls") pod "cluster-samples-operator-65db858894-v48n7" (UID: "542c2330-fd10-415c-8337-ec72bded2841") : secret "samples-operator-tls" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103033 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103121 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls podName:d79bd89e-e708-485a-9fef-fd373f5a87f8 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:44.103109827 +0000 UTC m=+52.171208663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls") pod "image-registry-66d9d8bff8-7hj84" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8") : secret "image-registry-tls" not found Jul 14 13:54:36.103293 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103148 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls podName:bc1ba704-85c2-4ed5-80f2-ed62c9f02272 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:44.103138689 +0000 UTC m=+52.171237527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bcmrf" (UID: "bc1ba704-85c2-4ed5-80f2-ed62c9f02272") : secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:36.103789 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.103168 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:54:44.103159699 +0000 UTC m=+52.171258535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : secret "router-metrics-certs-default" not found Jul 14 13:54:36.204490 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:36.204457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:36.204651 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.204629 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 13:54:36.204714 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:36.204703 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls podName:4e2f38ab-d834-4650-abf5-d0ca199c0da4 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:44.204683552 +0000 UTC m=+52.272782391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls") pod "dns-default-qr87g" (UID: "4e2f38ab-d834-4650-abf5-d0ca199c0da4") : secret "dns-default-metrics-tls" not found Jul 14 13:54:37.746959 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.746859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wpqwk" event={"ID":"e2ed97dc-eae1-4d05-9f84-96324bdf52eb","Type":"ContainerStarted","Data":"61a66bcfc7b2fc61f293e45b980cbb6b5ffc137b5c6900578b18ba592462d32a"} Jul 14 13:54:37.748447 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.748396 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" event={"ID":"0a91cba6-73c0-4713-a83a-c57abdfbb80e","Type":"ContainerStarted","Data":"ce5b70be2dcafd8dc6f39ba41cc9ae65a70cf9e7168d8ddcb59d9192e7a452bd"} Jul 14 13:54:37.750430 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.750068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" event={"ID":"3b3aa349-a588-4e4c-978b-0c5b0aa27216","Type":"ContainerStarted","Data":"70a7e39cc883a9819ee4b9269ec902d6ab719ed8d861a767dbcd6fb273d703d8"} Jul 14 13:54:37.751781 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.751761 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/0.log" Jul 14 13:54:37.751876 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.751801 2574 generic.go:356] "Generic (PLEG): container finished" podID="366945c0-3ffb-4b1d-9b27-0947917bf6d7" containerID="04e90ad4989af6c89f09a1305c28753d3f2cc18c3964afb0845b0d19ec9cc8e7" exitCode=255 Jul 14 13:54:37.751876 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.751828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gv99t" event={"ID":"366945c0-3ffb-4b1d-9b27-0947917bf6d7","Type":"ContainerDied","Data":"04e90ad4989af6c89f09a1305c28753d3f2cc18c3964afb0845b0d19ec9cc8e7"} Jul 14 13:54:37.752044 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.752026 2574 scope.go:117] "RemoveContainer" containerID="04e90ad4989af6c89f09a1305c28753d3f2cc18c3964afb0845b0d19ec9cc8e7" Jul 14 13:54:37.753692 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.753671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" event={"ID":"df04271c-2cc2-4129-a11c-76d256b11939","Type":"ContainerStarted","Data":"101f16765c415802df121eca835719fb128b0cb8d66678e70d7d6ca4dedfade5"} Jul 14 13:54:37.755165 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.755147 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" event={"ID":"a0d5223f-ddc7-4282-af3a-0eea59351161","Type":"ContainerStarted","Data":"ccab021cd1e00997d0ee7a8366e24517bc698754daa692a11a1b86f1164cef61"} Jul 14 13:54:37.768730 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.768684 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wpqwk" podStartSLOduration=1.961921125 podStartE2EDuration="9.768668586s" totalImagesPullingTime="7.806747461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:37.766522975 +0000 UTC m=+45.834621832" watchObservedRunningTime="2026-07-14 13:54:37.768668586 +0000 UTC m=+45.836767444" Jul 14 13:54:37.795199 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.794889 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" podStartSLOduration=8.019939104 podStartE2EDuration="15.794871535s" totalImagesPullingTime="7.774932431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:37.792886793 +0000 UTC m=+45.860985681" watchObservedRunningTime="2026-07-14 13:54:37.794871535 +0000 UTC m=+45.862970391" Jul 14 13:54:37.815820 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.815773 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" podStartSLOduration=8.042775696 podStartE2EDuration="15.815757731s" totalImagesPullingTime="7.772982035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:37.815230667 +0000 UTC m=+45.883329522" watchObservedRunningTime="2026-07-14 13:54:37.815757731 +0000 UTC m=+45.883856564" Jul 14 13:54:37.886637 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:37.886580 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qgx9n" podStartSLOduration=8.111853965 podStartE2EDuration="15.886559811s" totalImagesPullingTime="7.774705846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:37.859779615 +0000 UTC m=+45.927878471" watchObservedRunningTime="2026-07-14 13:54:37.886559811 +0000 UTC m=+45.954658667" Jul 14 13:54:38.208298 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.208227 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" podStartSLOduration=8.432947519 podStartE2EDuration="16.208201462s" totalImagesPullingTime="7.775253943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:37.885901767 +0000 UTC m=+45.954000623" watchObservedRunningTime="2026-07-14 13:54:38.208201462 +0000 UTC m=+46.276300316" Jul 14 13:54:38.209148 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.209121 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xpsp2"] Jul 14 13:54:38.230450 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.230417 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.231981 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.231956 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xpsp2"] Jul 14 13:54:38.241674 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.241654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 13:54:38.242352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.242335 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 13:54:38.251340 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.251318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rr67m\"" Jul 14 13:54:38.324295 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.323916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.324295 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.324027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.324295 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.324103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-data-volume\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.324295 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.324159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-crio-socket\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.324295 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.324205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqd8\" (UniqueName: \"kubernetes.io/projected/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-api-access-tvqd8\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425298 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425476 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-data-volume\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425476 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-crio-socket\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425476 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqd8\" (UniqueName: \"kubernetes.io/projected/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-api-access-tvqd8\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425476 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.425443 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 13:54:38.425476 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425724 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.425520 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:38.925499393 +0000 UTC m=+46.993598240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : secret "insights-runtime-extractor-tls" not found Jul 14 13:54:38.425724 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.425562 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 13:54:38.425724 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-crio-socket\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.425724 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.425616 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:38.925599494 +0000 UTC m=+46.993698350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : configmap "kube-rbac-proxy" not found Jul 14 13:54:38.425922 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.425764 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-data-volume\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.436989 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.436969 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqd8\" (UniqueName: \"kubernetes.io/projected/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-api-access-tvqd8\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.626241 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.626160 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:38.626241 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.626233 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:38.759943 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.759915 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 13:54:38.760341 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.760326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/0.log" Jul 14 13:54:38.760382 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.760360 2574 generic.go:356] "Generic (PLEG): container finished" podID="366945c0-3ffb-4b1d-9b27-0947917bf6d7" containerID="823eabae63a75b92dd1b364b28d74490ccb90118cc3194014ce90dec87a915d1" exitCode=255 Jul 14 13:54:38.760455 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.760429 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gv99t" event={"ID":"366945c0-3ffb-4b1d-9b27-0947917bf6d7","Type":"ContainerDied","Data":"823eabae63a75b92dd1b364b28d74490ccb90118cc3194014ce90dec87a915d1"} Jul 14 13:54:38.760589 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.760480 2574 scope.go:117] "RemoveContainer" containerID="04e90ad4989af6c89f09a1305c28753d3f2cc18c3964afb0845b0d19ec9cc8e7" Jul 14 13:54:38.760698 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.760677 2574 scope.go:117] "RemoveContainer" containerID="823eabae63a75b92dd1b364b28d74490ccb90118cc3194014ce90dec87a915d1" Jul 14 13:54:38.760946 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.760914 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gv99t_openshift-console-operator(366945c0-3ffb-4b1d-9b27-0947917bf6d7)\"" pod="openshift-console-operator/console-operator-7866497494-gv99t" podUID="366945c0-3ffb-4b1d-9b27-0947917bf6d7" Jul 14 13:54:38.932014 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.931982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.932166 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:38.932063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:38.932166 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.932109 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 13:54:38.932255 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.932198 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:39.932168275 +0000 UTC m=+48.000267117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : configmap "kube-rbac-proxy" not found Jul 14 13:54:38.932255 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.932219 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 13:54:38.932328 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:38.932276 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:39.932263434 +0000 UTC m=+48.000362268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : secret "insights-runtime-extractor-tls" not found Jul 14 13:54:39.249324 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.249258 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ffkp_19746321-8c32-49e7-8574-c1d3bb66276f/dns-node-resolver/0.log" Jul 14 13:54:39.724588 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.724555 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh"] Jul 14 13:54:39.764740 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.764712 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 13:54:39.765084 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.765030 2574 scope.go:117] "RemoveContainer" containerID="823eabae63a75b92dd1b364b28d74490ccb90118cc3194014ce90dec87a915d1" Jul 14 13:54:39.765277 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:39.765256 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gv99t_openshift-console-operator(366945c0-3ffb-4b1d-9b27-0947917bf6d7)\"" pod="openshift-console-operator/console-operator-7866497494-gv99t" podUID="366945c0-3ffb-4b1d-9b27-0947917bf6d7" Jul 14 13:54:39.766460 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.766442 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh"] Jul 14 13:54:39.766557 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.766545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" Jul 14 13:54:39.770414 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.770394 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 13:54:39.772885 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.772868 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 13:54:39.773689 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.773215 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fdb88\"" Jul 14 13:54:39.840197 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.840164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsncz\" (UniqueName: \"kubernetes.io/projected/622e7f31-fa21-47e3-9738-eed3c168bd84-kube-api-access-bsncz\") pod \"migrator-7f59b54f6c-hkjjh\" (UID: \"622e7f31-fa21-47e3-9738-eed3c168bd84\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" Jul 14 13:54:39.941597 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.941496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsncz\" (UniqueName: \"kubernetes.io/projected/622e7f31-fa21-47e3-9738-eed3c168bd84-kube-api-access-bsncz\") pod \"migrator-7f59b54f6c-hkjjh\" (UID: \"622e7f31-fa21-47e3-9738-eed3c168bd84\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" Jul 14 13:54:39.941775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.941626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:39.941775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.941707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:39.941775 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:39.941748 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 13:54:39.941917 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:39.941785 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 13:54:39.941917 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:39.941816 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:41.941795348 +0000 UTC m=+50.009894195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : configmap "kube-rbac-proxy" not found Jul 14 13:54:39.941917 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:39.941900 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:41.941890621 +0000 UTC m=+50.009989461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : secret "insights-runtime-extractor-tls" not found Jul 14 13:54:39.952241 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:39.952214 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsncz\" (UniqueName: \"kubernetes.io/projected/622e7f31-fa21-47e3-9738-eed3c168bd84-kube-api-access-bsncz\") pod \"migrator-7f59b54f6c-hkjjh\" (UID: \"622e7f31-fa21-47e3-9738-eed3c168bd84\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" Jul 14 13:54:40.075843 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.075766 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" Jul 14 13:54:40.221003 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.220964 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh"] Jul 14 13:54:40.224597 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:40.224575 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622e7f31_fa21_47e3_9738_eed3c168bd84.slice/crio-b5fcf86f7573a7e4d7c613bfae84aa85a2803db3a840a53a60fd0ddd393add1c WatchSource:0}: Error finding container b5fcf86f7573a7e4d7c613bfae84aa85a2803db3a840a53a60fd0ddd393add1c: Status 404 returned error can't find the container with id b5fcf86f7573a7e4d7c613bfae84aa85a2803db3a840a53a60fd0ddd393add1c Jul 14 13:54:40.405029 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.404961 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6247h_e61db8eb-06c6-4f98-a037-d431374d297b/node-ca/0.log" Jul 14 13:54:40.769330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.769244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" event={"ID":"622e7f31-fa21-47e3-9738-eed3c168bd84","Type":"ContainerStarted","Data":"b5fcf86f7573a7e4d7c613bfae84aa85a2803db3a840a53a60fd0ddd393add1c"} Jul 14 13:54:40.809821 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.809793 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pbbjn"] Jul 14 13:54:40.847086 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.847050 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pbbjn"] Jul 14 13:54:40.847269 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.847161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:40.849597 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.849573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 13:54:40.849716 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.849584 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 13:54:40.850410 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.850393 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 13:54:40.850410 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.850401 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lj54r\"" Jul 14 13:54:40.850410 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.850402 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 13:54:40.949869 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.949836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnl4\" (UniqueName: \"kubernetes.io/projected/50488129-4ed7-41bc-90ea-57b01614b2b1-kube-api-access-grnl4\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:40.950046 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.949877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/50488129-4ed7-41bc-90ea-57b01614b2b1-signing-key\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:40.950116 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:40.950038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/50488129-4ed7-41bc-90ea-57b01614b2b1-signing-cabundle\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.004433 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.004407 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wpqwk_e2ed97dc-eae1-4d05-9f84-96324bdf52eb/serve-healthcheck-canary/0.log" Jul 14 13:54:41.050920 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.050823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/50488129-4ed7-41bc-90ea-57b01614b2b1-signing-cabundle\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.051090 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.050992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnl4\" (UniqueName: \"kubernetes.io/projected/50488129-4ed7-41bc-90ea-57b01614b2b1-kube-api-access-grnl4\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.051090 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.051031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/50488129-4ed7-41bc-90ea-57b01614b2b1-signing-key\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.051816 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.051792 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/50488129-4ed7-41bc-90ea-57b01614b2b1-signing-cabundle\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.053910 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.053891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/50488129-4ed7-41bc-90ea-57b01614b2b1-signing-key\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.060906 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.060881 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnl4\" (UniqueName: \"kubernetes.io/projected/50488129-4ed7-41bc-90ea-57b01614b2b1-kube-api-access-grnl4\") pod \"service-ca-79f68b9f4f-pbbjn\" (UID: \"50488129-4ed7-41bc-90ea-57b01614b2b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.155737 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.155699 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" Jul 14 13:54:41.305383 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.305315 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pbbjn"] Jul 14 13:54:41.308102 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:41.308077 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50488129_4ed7_41bc_90ea_57b01614b2b1.slice/crio-53f06a653ee83ae6b8d54d619d0d29782d2f0a4bfacc9ff387c62e39b1717079 WatchSource:0}: Error finding container 53f06a653ee83ae6b8d54d619d0d29782d2f0a4bfacc9ff387c62e39b1717079: Status 404 returned error can't find the container with id 53f06a653ee83ae6b8d54d619d0d29782d2f0a4bfacc9ff387c62e39b1717079 Jul 14 13:54:41.774473 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.774435 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" event={"ID":"50488129-4ed7-41bc-90ea-57b01614b2b1","Type":"ContainerStarted","Data":"d31bc9cfd4d2cf06d46147f03361139c7be921c6bdd5d906fe32ed633a610a6f"} Jul 14 13:54:41.774886 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.774485 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" event={"ID":"50488129-4ed7-41bc-90ea-57b01614b2b1","Type":"ContainerStarted","Data":"53f06a653ee83ae6b8d54d619d0d29782d2f0a4bfacc9ff387c62e39b1717079"} Jul 14 13:54:41.793131 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.793083 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-pbbjn" podStartSLOduration=1.793069908 podStartE2EDuration="1.793069908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:41.791789442 +0000 UTC m=+49.859888297" watchObservedRunningTime="2026-07-14 13:54:41.793069908 +0000 UTC m=+49.861168763" Jul 14 13:54:41.958717 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.958686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:41.958874 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:41.958759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:41.958874 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:41.958839 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 13:54:41.958874 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:41.958854 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 13:54:41.958972 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:41.958896 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:45.958882093 +0000 UTC m=+54.026980927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : configmap "kube-rbac-proxy" not found Jul 14 13:54:41.958972 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:41.958910 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:45.958904012 +0000 UTC m=+54.027002845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : secret "insights-runtime-extractor-tls" not found Jul 14 13:54:42.781109 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:42.781073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" event={"ID":"622e7f31-fa21-47e3-9738-eed3c168bd84","Type":"ContainerStarted","Data":"eee1709e26d78f369f985dc5947a950c1a7fdd8ce9189bbff3242857b641da40"} Jul 14 13:54:42.781588 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:42.781132 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" event={"ID":"622e7f31-fa21-47e3-9738-eed3c168bd84","Type":"ContainerStarted","Data":"25240be1967264afdec694bd64247233d5ee967dd8fc137600cd796521e58d51"} Jul 14 13:54:44.181113 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:44.181074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:44.181148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:44.181246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181273 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:55:00.181249764 +0000 UTC m=+68.249348620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : configmap references non-existent config key: service-ca.crt Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181304 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181331 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:44.181341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181363 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls podName:542c2330-fd10-415c-8337-ec72bded2841 nodeName:}" failed. No retries permitted until 2026-07-14 13:55:00.181345918 +0000 UTC m=+68.249444753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls") pod "cluster-samples-operator-65db858894-v48n7" (UID: "542c2330-fd10-415c-8337-ec72bded2841") : secret "samples-operator-tls" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181387 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs podName:baabe0fd-609f-4826-b7df-f08652ac60ab nodeName:}" failed. No retries permitted until 2026-07-14 13:55:00.181373028 +0000 UTC m=+68.249471865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs") pod "router-default-86c6b64644-bzmkz" (UID: "baabe0fd-609f-4826-b7df-f08652ac60ab") : secret "router-metrics-certs-default" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181398 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181423 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d9d8bff8-7hj84: secret "image-registry-tls" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:44.181432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181457 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls podName:d79bd89e-e708-485a-9fef-fd373f5a87f8 nodeName:}" failed. No retries permitted until 2026-07-14 13:55:00.181448457 +0000 UTC m=+68.249547294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls") pod "image-registry-66d9d8bff8-7hj84" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8") : secret "image-registry-tls" not found Jul 14 13:54:44.181586 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181495 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:44.182053 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.181537 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls podName:bc1ba704-85c2-4ed5-80f2-ed62c9f02272 nodeName:}" failed. No retries permitted until 2026-07-14 13:55:00.181525742 +0000 UTC m=+68.249624578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bcmrf" (UID: "bc1ba704-85c2-4ed5-80f2-ed62c9f02272") : secret "cluster-monitoring-operator-tls" not found Jul 14 13:54:44.282614 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:44.282583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:54:44.282772 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.282741 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 13:54:44.282814 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:44.282804 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls podName:4e2f38ab-d834-4650-abf5-d0ca199c0da4 nodeName:}" failed. No retries permitted until 2026-07-14 13:55:00.282789207 +0000 UTC m=+68.350888039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls") pod "dns-default-qr87g" (UID: "4e2f38ab-d834-4650-abf5-d0ca199c0da4") : secret "dns-default-metrics-tls" not found Jul 14 13:54:45.999394 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:45.999359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:45.999913 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:45.999437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:45.999913 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:45.999571 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 13:54:45.999913 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:54:45.999641 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls podName:f6bd7139-4dd7-4d55-9dd5-eed2201ce179 nodeName:}" failed. No retries permitted until 2026-07-14 13:54:53.999622099 +0000 UTC m=+62.067720933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xpsp2" (UID: "f6bd7139-4dd7-4d55-9dd5-eed2201ce179") : secret "insights-runtime-extractor-tls" not found Jul 14 13:54:46.000080 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:45.999983 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:48.625839 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.625807 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:48.626417 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.625870 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:48.626417 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.626283 2574 scope.go:117] "RemoveContainer" containerID="823eabae63a75b92dd1b364b28d74490ccb90118cc3194014ce90dec87a915d1" Jul 14 13:54:48.802836 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.802810 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 13:54:48.802993 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.802875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gv99t" event={"ID":"366945c0-3ffb-4b1d-9b27-0947917bf6d7","Type":"ContainerStarted","Data":"1d5905d0ece0074f546e1f5727fa5d939f21863675436bb340db47b872483084"} Jul 14 13:54:48.803143 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.803124 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:48.822790 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.822725 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-gv99t" podStartSLOduration=19.042611389 podStartE2EDuration="26.822706957s" totalImagesPullingTime="7.780095568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:48.82252523 +0000 UTC m=+56.890624098" watchObservedRunningTime="2026-07-14 13:54:48.822706957 +0000 UTC m=+56.890805816" Jul 14 13:54:48.828263 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:48.824068 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkjjh" podStartSLOduration=7.9608172790000005 podStartE2EDuration="9.824048651s" totalImagesPullingTime="1.863231372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:42.804052465 +0000 UTC m=+50.872151322" watchObservedRunningTime="2026-07-14 13:54:48.824048651 +0000 UTC m=+56.892147507" Jul 14 13:54:49.803297 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:49.803257 2574 patch_prober.go:28] interesting pod/console-operator-7866497494-gv99t container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 13:54:49.803728 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:49.803336 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-gv99t" podUID="366945c0-3ffb-4b1d-9b27-0947917bf6d7" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 14 13:54:50.506921 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:50.506894 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-gv99t" Jul 14 13:54:53.685319 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:53.685290 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44t9t" Jul 14 13:54:54.072872 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:54.072800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:54.075109 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:54.075076 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6bd7139-4dd7-4d55-9dd5-eed2201ce179-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpsp2\" (UID: \"f6bd7139-4dd7-4d55-9dd5-eed2201ce179\") " pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:54.144574 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:54.144547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rr67m\"" Jul 14 13:54:54.152957 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:54.152932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xpsp2" Jul 14 13:54:54.277967 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:54.277942 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xpsp2"] Jul 14 13:54:54.280655 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:54.280634 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bd7139_4dd7_4d55_9dd5_eed2201ce179.slice/crio-f8a9df9b5ba9c07ef4dd49e6613e2057b9ac0bdfe01d5ad92fedaeb99ebffadf WatchSource:0}: Error finding container f8a9df9b5ba9c07ef4dd49e6613e2057b9ac0bdfe01d5ad92fedaeb99ebffadf: Status 404 returned error can't find the container with id f8a9df9b5ba9c07ef4dd49e6613e2057b9ac0bdfe01d5ad92fedaeb99ebffadf Jul 14 13:54:54.821573 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:54.821539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpsp2" event={"ID":"f6bd7139-4dd7-4d55-9dd5-eed2201ce179","Type":"ContainerStarted","Data":"f8a9df9b5ba9c07ef4dd49e6613e2057b9ac0bdfe01d5ad92fedaeb99ebffadf"} Jul 14 13:54:58.212712 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.212669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:58.213173 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.212728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:58.216894 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.216871 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 13:54:58.217017 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.216909 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 13:54:58.226512 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.226493 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1b6fb18-b4c3-4f89-b300-668bedc1d7ee-original-pull-secret\") pod \"global-pull-secret-syncer-4c9nv\" (UID: \"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee\") " pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:58.226621 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.226539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9061185-b7c8-44eb-b1fc-1103dbe70ef0-metrics-certs\") pod \"network-metrics-daemon-rkj9w\" (UID: \"e9061185-b7c8-44eb-b1fc-1103dbe70ef0\") " pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:58.290145 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.290119 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9nv" Jul 14 13:54:58.303010 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.302991 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v5knd\"" Jul 14 13:54:58.311209 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.311178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rkj9w" Jul 14 13:54:58.415973 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.415856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:58.418997 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.418963 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qvw\" (UniqueName: \"kubernetes.io/projected/844cc775-e693-42c0-958b-044583a4bce3-kube-api-access-n7qvw\") pod \"network-check-target-zb2bw\" (UID: \"844cc775-e693-42c0-958b-044583a4bce3\") " pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:58.499073 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.499046 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rkj9w"] Jul 14 13:54:58.503179 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:58.503134 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9061185_b7c8_44eb_b1fc_1103dbe70ef0.slice/crio-9e6e01f2f73ab862215fc844c8ba4b01149afbff52acf17c6199f595cf82033d WatchSource:0}: Error finding container 9e6e01f2f73ab862215fc844c8ba4b01149afbff52acf17c6199f595cf82033d: Status 404 returned error can't find the container with id 9e6e01f2f73ab862215fc844c8ba4b01149afbff52acf17c6199f595cf82033d Jul 14 13:54:58.514453 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.514392 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4c9nv"] Jul 14 13:54:58.519066 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:58.519042 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b6fb18_b4c3_4f89_b300_668bedc1d7ee.slice/crio-643cf3c567a16fb3a6aba74525f6a2745beeee1ca8ba53f31728473503ad16f6 WatchSource:0}: Error finding container 643cf3c567a16fb3a6aba74525f6a2745beeee1ca8ba53f31728473503ad16f6: Status 404 returned error can't find the container with id 643cf3c567a16fb3a6aba74525f6a2745beeee1ca8ba53f31728473503ad16f6 Jul 14 13:54:58.598586 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.598561 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7c4p6\"" Jul 14 13:54:58.606451 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.606431 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:58.731135 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.731065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb2bw"] Jul 14 13:54:58.733925 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:54:58.733901 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844cc775_e693_42c0_958b_044583a4bce3.slice/crio-55c4cf0ff3d964b21a771ad4b12eb956ab767472877487f2d98274ca19e32061 WatchSource:0}: Error finding container 55c4cf0ff3d964b21a771ad4b12eb956ab767472877487f2d98274ca19e32061: Status 404 returned error can't find the container with id 55c4cf0ff3d964b21a771ad4b12eb956ab767472877487f2d98274ca19e32061 Jul 14 13:54:58.836482 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.836452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpsp2" event={"ID":"f6bd7139-4dd7-4d55-9dd5-eed2201ce179","Type":"ContainerStarted","Data":"afc13ef3baeed0325bec7fc3450501438e3e42d94b1b4bf81f0aeb6f86e15ac1"} Jul 14 13:54:58.837496 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.837467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4c9nv" event={"ID":"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee","Type":"ContainerStarted","Data":"643cf3c567a16fb3a6aba74525f6a2745beeee1ca8ba53f31728473503ad16f6"} Jul 14 13:54:58.838569 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.838547 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rkj9w" event={"ID":"e9061185-b7c8-44eb-b1fc-1103dbe70ef0","Type":"ContainerStarted","Data":"9e6e01f2f73ab862215fc844c8ba4b01149afbff52acf17c6199f595cf82033d"} Jul 14 13:54:58.839941 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.839919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb2bw" event={"ID":"844cc775-e693-42c0-958b-044583a4bce3","Type":"ContainerStarted","Data":"36c611e14cc45c557b8fdf169239af23590874bc3fb71f0ba69d95c1bb40d8e3"} Jul 14 13:54:58.840040 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.839962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb2bw" event={"ID":"844cc775-e693-42c0-958b-044583a4bce3","Type":"ContainerStarted","Data":"55c4cf0ff3d964b21a771ad4b12eb956ab767472877487f2d98274ca19e32061"} Jul 14 13:54:58.840109 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.840034 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:54:58.856779 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:58.856739 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zb2bw" podStartSLOduration=66.856725919 podStartE2EDuration="1m6.856725919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:54:58.856290981 +0000 UTC m=+66.924389857" watchObservedRunningTime="2026-07-14 13:54:58.856725919 +0000 UTC m=+66.924824774" Jul 14 13:54:59.844440 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:54:59.844407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpsp2" event={"ID":"f6bd7139-4dd7-4d55-9dd5-eed2201ce179","Type":"ContainerStarted","Data":"8e31284403585381e45252d3514045048ece437fae627b5546deb34b81dcab21"} Jul 14 13:55:00.231495 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.231472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:00.231630 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.231508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:00.231630 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.231546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:55:00.231630 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.231582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:00.231630 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.231621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:55:00.232768 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.232715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baabe0fd-609f-4826-b7df-f08652ac60ab-service-ca-bundle\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:00.234135 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.234109 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"image-registry-66d9d8bff8-7hj84\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:00.234341 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.234318 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/542c2330-fd10-415c-8337-ec72bded2841-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-v48n7\" (UID: \"542c2330-fd10-415c-8337-ec72bded2841\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:55:00.234517 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.234496 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baabe0fd-609f-4826-b7df-f08652ac60ab-metrics-certs\") pod \"router-default-86c6b64644-bzmkz\" (UID: \"baabe0fd-609f-4826-b7df-f08652ac60ab\") " pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:00.235005 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.234981 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc1ba704-85c2-4ed5-80f2-ed62c9f02272-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bcmrf\" (UID: \"bc1ba704-85c2-4ed5-80f2-ed62c9f02272\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:55:00.332960 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.332917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:55:00.336179 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.336123 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e2f38ab-d834-4650-abf5-d0ca199c0da4-metrics-tls\") pod \"dns-default-qr87g\" (UID: \"4e2f38ab-d834-4650-abf5-d0ca199c0da4\") " pod="openshift-dns/dns-default-qr87g" Jul 14 13:55:00.371061 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.370983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d4hld\"" Jul 14 13:55:00.379291 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.379248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:00.410213 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.410173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4ngzp\"" Jul 14 13:55:00.417825 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.417594 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" Jul 14 13:55:00.446537 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.446334 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jdhdm\"" Jul 14 13:55:00.451678 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.451440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:00.453593 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.453570 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lmk28\"" Jul 14 13:55:00.462585 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.462547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" Jul 14 13:55:00.491694 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.491617 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mh5f9\"" Jul 14 13:55:00.496766 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.496676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qr87g" Jul 14 13:55:00.584736 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.583520 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d9d8bff8-7hj84"] Jul 14 13:55:00.684710 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.683448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7"] Jul 14 13:55:00.732775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.732694 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86c6b64644-bzmkz"] Jul 14 13:55:00.737534 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:00.737498 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaabe0fd_609f_4826_b7df_f08652ac60ab.slice/crio-3d4593445e84e112d1a0ebf904a8c3ecbc971f209c5f14398472d10f9b5483ee WatchSource:0}: Error finding container 3d4593445e84e112d1a0ebf904a8c3ecbc971f209c5f14398472d10f9b5483ee: Status 404 returned error can't find the container with id 3d4593445e84e112d1a0ebf904a8c3ecbc971f209c5f14398472d10f9b5483ee Jul 14 13:55:00.754846 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.754805 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qr87g"] Jul 14 13:55:00.761111 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:00.761075 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2f38ab_d834_4650_abf5_d0ca199c0da4.slice/crio-2881588d79391c3ec3c0207c23ac01ed14c2c8a49e65dc641947d4f0d57eb290 WatchSource:0}: Error finding container 2881588d79391c3ec3c0207c23ac01ed14c2c8a49e65dc641947d4f0d57eb290: Status 404 returned error can't find the container with id 2881588d79391c3ec3c0207c23ac01ed14c2c8a49e65dc641947d4f0d57eb290 Jul 14 13:55:00.775510 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.775411 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf"] Jul 14 13:55:00.850694 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.850658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" event={"ID":"542c2330-fd10-415c-8337-ec72bded2841","Type":"ContainerStarted","Data":"fba6dfd723d9dfc236bf5b2d3010d630f4adb36526dcb944ed4e9f5ceb2b9d9c"} Jul 14 13:55:00.853644 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.853609 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rkj9w" event={"ID":"e9061185-b7c8-44eb-b1fc-1103dbe70ef0","Type":"ContainerStarted","Data":"05ffa5f0a4d100729fcef4b85133eda22ce76677d917133a32d3f314de82b664"} Jul 14 13:55:00.853760 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.853666 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rkj9w" event={"ID":"e9061185-b7c8-44eb-b1fc-1103dbe70ef0","Type":"ContainerStarted","Data":"ebd2f5e4956d0f2e5907aa66723c6a67a482719df5ca088000ea2d573355598e"} Jul 14 13:55:00.855635 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.855291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" event={"ID":"bc1ba704-85c2-4ed5-80f2-ed62c9f02272","Type":"ContainerStarted","Data":"0603bb69fa27b44fb68cb995895b37dcc6888ea9e880680ce0906e2724f2260b"} Jul 14 13:55:00.857833 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.857807 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86c6b64644-bzmkz" event={"ID":"baabe0fd-609f-4826-b7df-f08652ac60ab","Type":"ContainerStarted","Data":"3d4593445e84e112d1a0ebf904a8c3ecbc971f209c5f14398472d10f9b5483ee"} Jul 14 13:55:00.860168 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.860114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qr87g" event={"ID":"4e2f38ab-d834-4650-abf5-d0ca199c0da4","Type":"ContainerStarted","Data":"2881588d79391c3ec3c0207c23ac01ed14c2c8a49e65dc641947d4f0d57eb290"} Jul 14 13:55:00.863371 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.863345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" event={"ID":"d79bd89e-e708-485a-9fef-fd373f5a87f8","Type":"ContainerStarted","Data":"b1f87388d83a8c644e37c08711e986713d397c85fa9065f45681e963e4f1ac33"} Jul 14 13:55:00.863473 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.863389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" event={"ID":"d79bd89e-e708-485a-9fef-fd373f5a87f8","Type":"ContainerStarted","Data":"09d46ad76473a1a460203e8ca57d40b32723f94b21c6982d6a0dbadf06517242"} Jul 14 13:55:00.863912 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.863874 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:00.872160 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.872110 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rkj9w" podStartSLOduration=67.411975298 podStartE2EDuration="1m8.872092806s" totalImagesPullingTime="1.460117508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:00.870380705 +0000 UTC m=+68.938479583" watchObservedRunningTime="2026-07-14 13:55:00.872092806 +0000 UTC m=+68.940191661" Jul 14 13:55:00.890866 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:00.890777 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" podStartSLOduration=67.890756348 podStartE2EDuration="1m7.890756348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:00.888982092 +0000 UTC m=+68.957080940" watchObservedRunningTime="2026-07-14 13:55:00.890756348 +0000 UTC m=+68.958855206" Jul 14 13:55:01.878798 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.878122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86c6b64644-bzmkz" event={"ID":"baabe0fd-609f-4826-b7df-f08652ac60ab","Type":"ContainerStarted","Data":"85ef091165a34c8450279ad7c07eae6eeae268d4a8a6e596cadad5aafe819b34"} Jul 14 13:55:01.907361 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.906327 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86c6b64644-bzmkz" podStartSLOduration=39.90630495 podStartE2EDuration="39.90630495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:01.905155141 +0000 UTC m=+69.973254024" watchObservedRunningTime="2026-07-14 13:55:01.90630495 +0000 UTC m=+69.974403806" Jul 14 13:55:01.977120 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.975840 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-25l5p"] Jul 14 13:55:01.980532 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.980504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:01.983492 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.982838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6rk75\"" Jul 14 13:55:01.983492 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.983088 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 13:55:01.983492 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.983318 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2"] Jul 14 13:55:01.985207 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.985147 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 13:55:01.988343 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.987457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np"] Jul 14 13:55:01.994167 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.994148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.000806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.998527 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 13:55:02.000806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.999519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 13:55:02.000806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:01.999754 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 13:55:02.000806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.000029 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 13:55:02.003588 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.001350 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd"] Jul 14 13:55:02.006102 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.005092 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-25l5p"] Jul 14 13:55:02.006102 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.005227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.006102 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.005237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.008080 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.008061 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 13:55:02.008644 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.008321 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd"] Jul 14 13:55:02.009013 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.008465 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vszbp\"" Jul 14 13:55:02.009328 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.008869 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 13:55:02.009989 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.008953 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 13:55:02.010301 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.009638 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 13:55:02.013484 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.009785 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 13:55:02.013776 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.012026 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np"] Jul 14 13:55:02.021143 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.017897 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2"] Jul 14 13:55:02.088434 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.088399 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-4nfqb"] Jul 14 13:55:02.092174 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.091899 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:02.095783 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.095451 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qfb8l\"" Jul 14 13:55:02.095908 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.095792 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 13:55:02.095981 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.095796 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 13:55:02.104451 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.104392 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4nfqb"] Jul 14 13:55:02.152012 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.151925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-hub\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.152012 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.151975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jf5p\" (UniqueName: \"kubernetes.io/projected/9920b66e-45e1-4017-9031-aa4a3c622c10-kube-api-access-5jf5p\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b9b574d-ae87-4cdf-813d-1a69fd80258b-tmp\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-ca\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b18e5b0-77ab-486e-9250-07a2dd24cdb7-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25l5p\" (UID: \"5b18e5b0-77ab-486e-9250-07a2dd24cdb7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b9b574d-ae87-4cdf-813d-1a69fd80258b-klusterlet-config\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.152247 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b18e5b0-77ab-486e-9250-07a2dd24cdb7-nginx-conf\") pod \"networking-console-plugin-6cf856758c-25l5p\" (UID: \"5b18e5b0-77ab-486e-9250-07a2dd24cdb7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.152598 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlkpv\" (UniqueName: \"kubernetes.io/projected/bacf787f-2d10-42b5-b088-436869d4a1fe-kube-api-access-zlkpv\") pod \"managed-serviceaccount-addon-agent-d88dbf468-f4jdd\" (UID: \"bacf787f-2d10-42b5-b088-436869d4a1fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.152598 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjcz\" (UniqueName: \"kubernetes.io/projected/0b9b574d-ae87-4cdf-813d-1a69fd80258b-kube-api-access-wpjcz\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.152598 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bacf787f-2d10-42b5-b088-436869d4a1fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d88dbf468-f4jdd\" (UID: \"bacf787f-2d10-42b5-b088-436869d4a1fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.152598 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.152371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9920b66e-45e1-4017-9031-aa4a3c622c10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b9b574d-ae87-4cdf-813d-1a69fd80258b-klusterlet-config\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b18e5b0-77ab-486e-9250-07a2dd24cdb7-nginx-conf\") pod \"networking-console-plugin-6cf856758c-25l5p\" (UID: \"5b18e5b0-77ab-486e-9250-07a2dd24cdb7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlkpv\" (UniqueName: \"kubernetes.io/projected/bacf787f-2d10-42b5-b088-436869d4a1fe-kube-api-access-zlkpv\") pod \"managed-serviceaccount-addon-agent-d88dbf468-f4jdd\" (UID: \"bacf787f-2d10-42b5-b088-436869d4a1fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjcz\" (UniqueName: \"kubernetes.io/projected/0b9b574d-ae87-4cdf-813d-1a69fd80258b-kube-api-access-wpjcz\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bacf787f-2d10-42b5-b088-436869d4a1fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d88dbf468-f4jdd\" (UID: \"bacf787f-2d10-42b5-b088-436869d4a1fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9920b66e-45e1-4017-9031-aa4a3c622c10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.253980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-hub\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jf5p\" (UniqueName: \"kubernetes.io/projected/9920b66e-45e1-4017-9031-aa4a3c622c10-kube-api-access-5jf5p\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b9b574d-ae87-4cdf-813d-1a69fd80258b-tmp\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-ca\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.254403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64bvz\" (UniqueName: \"kubernetes.io/projected/6a72e177-558e-439c-a509-1dac34de6b34-kube-api-access-64bvz\") pod \"downloads-68c9cbb497-4nfqb\" (UID: \"6a72e177-558e-439c-a509-1dac34de6b34\") " pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:02.255142 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b18e5b0-77ab-486e-9250-07a2dd24cdb7-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25l5p\" (UID: \"5b18e5b0-77ab-486e-9250-07a2dd24cdb7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.255142 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.254197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.255142 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.255014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b9b574d-ae87-4cdf-813d-1a69fd80258b-tmp\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.256426 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.255859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b18e5b0-77ab-486e-9250-07a2dd24cdb7-nginx-conf\") pod \"networking-console-plugin-6cf856758c-25l5p\" (UID: \"5b18e5b0-77ab-486e-9250-07a2dd24cdb7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.257401 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.257344 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9920b66e-45e1-4017-9031-aa4a3c622c10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.271224 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.268873 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.271224 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.270817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b18e5b0-77ab-486e-9250-07a2dd24cdb7-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-25l5p\" (UID: \"5b18e5b0-77ab-486e-9250-07a2dd24cdb7\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.271224 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.271010 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0b9b574d-ae87-4cdf-813d-1a69fd80258b-klusterlet-config\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.271224 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.271151 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bacf787f-2d10-42b5-b088-436869d4a1fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d88dbf468-f4jdd\" (UID: \"bacf787f-2d10-42b5-b088-436869d4a1fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.278417 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.271804 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-ca\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.278814 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.278758 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-hub\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.278922 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.278817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjcz\" (UniqueName: \"kubernetes.io/projected/0b9b574d-ae87-4cdf-813d-1a69fd80258b-kube-api-access-wpjcz\") pod \"klusterlet-addon-workmgr-85f94ccbc7-klwc2\" (UID: \"0b9b574d-ae87-4cdf-813d-1a69fd80258b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.279474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.279433 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9920b66e-45e1-4017-9031-aa4a3c622c10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.280615 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.280573 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlkpv\" (UniqueName: \"kubernetes.io/projected/bacf787f-2d10-42b5-b088-436869d4a1fe-kube-api-access-zlkpv\") pod \"managed-serviceaccount-addon-agent-d88dbf468-f4jdd\" (UID: \"bacf787f-2d10-42b5-b088-436869d4a1fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.281733 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.281711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jf5p\" (UniqueName: \"kubernetes.io/projected/9920b66e-45e1-4017-9031-aa4a3c622c10-kube-api-access-5jf5p\") pod \"cluster-proxy-proxy-agent-5bfc86d9fc-wr2np\" (UID: \"9920b66e-45e1-4017-9031-aa4a3c622c10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.307509 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.307483 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" Jul 14 13:55:02.329491 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.329465 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:02.351075 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.351040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" Jul 14 13:55:02.355265 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.355242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" Jul 14 13:55:02.355784 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.355435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64bvz\" (UniqueName: \"kubernetes.io/projected/6a72e177-558e-439c-a509-1dac34de6b34-kube-api-access-64bvz\") pod \"downloads-68c9cbb497-4nfqb\" (UID: \"6a72e177-558e-439c-a509-1dac34de6b34\") " pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:02.366193 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.366168 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64bvz\" (UniqueName: \"kubernetes.io/projected/6a72e177-558e-439c-a509-1dac34de6b34-kube-api-access-64bvz\") pod \"downloads-68c9cbb497-4nfqb\" (UID: \"6a72e177-558e-439c-a509-1dac34de6b34\") " pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:02.413784 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.413755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:02.452272 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.452243 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:02.454957 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.454736 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:02.882845 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.882625 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:02.883952 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:02.883921 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86c6b64644-bzmkz" Jul 14 13:55:05.220144 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.220104 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc65fc57f-rg8zc"] Jul 14 13:55:05.226902 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.226875 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.229950 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.229921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 13:55:05.231027 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.230716 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 13:55:05.231027 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.230738 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 13:55:05.231027 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.230762 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 13:55:05.231027 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.230858 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qrpw7\"" Jul 14 13:55:05.231027 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.230858 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 13:55:05.237403 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.237366 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc65fc57f-rg8zc"] Jul 14 13:55:05.381806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.381775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-serving-cert\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.381806 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.381810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-service-ca\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.382021 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.381826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-oauth-config\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.382021 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.381969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-config\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.382088 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.382018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92td7\" (UniqueName: \"kubernetes.io/projected/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-kube-api-access-92td7\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.382088 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.382077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-oauth-serving-cert\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.482713 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.482622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-serving-cert\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.482713 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.482676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-service-ca\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.482713 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.482702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-oauth-config\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.482988 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.482776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-config\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.482988 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.482824 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92td7\" (UniqueName: \"kubernetes.io/projected/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-kube-api-access-92td7\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.482988 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.482863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-oauth-serving-cert\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.483590 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.483560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-config\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.483722 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.483590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-oauth-serving-cert\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.483722 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.483560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-service-ca\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.485639 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.485593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-oauth-config\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.485729 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.485653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-serving-cert\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.496850 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.496811 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92td7\" (UniqueName: \"kubernetes.io/projected/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-kube-api-access-92td7\") pod \"console-fc65fc57f-rg8zc\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:05.538071 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:05.538050 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:06.360232 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.358851 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd"] Jul 14 13:55:06.494308 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.494278 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4nfqb"] Jul 14 13:55:06.500559 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.500535 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-25l5p"] Jul 14 13:55:06.628721 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.628623 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np"] Jul 14 13:55:06.631362 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:06.631330 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9920b66e_45e1_4017_9031_aa4a3c622c10.slice/crio-580e3fef4ba61429e9168d74b4a6c11144e18699d1cd726f0494dd0d0073b91f WatchSource:0}: Error finding container 580e3fef4ba61429e9168d74b4a6c11144e18699d1cd726f0494dd0d0073b91f: Status 404 returned error can't find the container with id 580e3fef4ba61429e9168d74b4a6c11144e18699d1cd726f0494dd0d0073b91f Jul 14 13:55:06.631506 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.631486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2"] Jul 14 13:55:06.636009 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:06.635987 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9b574d_ae87_4cdf_813d_1a69fd80258b.slice/crio-fdcfe6e297bb736a28d599c847b96fe06e9b3a806e96f5f971d24d38cadd900b WatchSource:0}: Error finding container fdcfe6e297bb736a28d599c847b96fe06e9b3a806e96f5f971d24d38cadd900b: Status 404 returned error can't find the container with id fdcfe6e297bb736a28d599c847b96fe06e9b3a806e96f5f971d24d38cadd900b Jul 14 13:55:06.715702 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.715677 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc65fc57f-rg8zc"] Jul 14 13:55:06.719418 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:06.719381 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa48676_70d6_4ef5_9f1a_da5ef6f29ce4.slice/crio-a264e478956276f6be75d4f0c196c205f741c02fc733ccf516697f89b8099b7b WatchSource:0}: Error finding container a264e478956276f6be75d4f0c196c205f741c02fc733ccf516697f89b8099b7b: Status 404 returned error can't find the container with id a264e478956276f6be75d4f0c196c205f741c02fc733ccf516697f89b8099b7b Jul 14 13:55:06.900143 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.900059 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4c9nv" event={"ID":"a1b6fb18-b4c3-4f89-b300-668bedc1d7ee","Type":"ContainerStarted","Data":"903a7aaf12d0f44b5c8460baa104f3474d49ae327f189be14ef67a76a9aec0ff"} Jul 14 13:55:06.901435 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.901410 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc65fc57f-rg8zc" event={"ID":"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4","Type":"ContainerStarted","Data":"a264e478956276f6be75d4f0c196c205f741c02fc733ccf516697f89b8099b7b"} Jul 14 13:55:06.902595 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.902565 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" event={"ID":"9920b66e-45e1-4017-9031-aa4a3c622c10","Type":"ContainerStarted","Data":"580e3fef4ba61429e9168d74b4a6c11144e18699d1cd726f0494dd0d0073b91f"} Jul 14 13:55:06.904545 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.904522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qr87g" event={"ID":"4e2f38ab-d834-4650-abf5-d0ca199c0da4","Type":"ContainerStarted","Data":"c36c53c46fa5a631c2e119f153c0dabef693bf06506e32585c53e5203ae664bf"} Jul 14 13:55:06.904655 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.904570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qr87g" event={"ID":"4e2f38ab-d834-4650-abf5-d0ca199c0da4","Type":"ContainerStarted","Data":"c56054f1599a9b3fc6408293b0127acc4d72e2ad92ad79a258aa628ace4b6b28"} Jul 14 13:55:06.904655 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.904621 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qr87g" Jul 14 13:55:06.906625 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.906606 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpsp2" event={"ID":"f6bd7139-4dd7-4d55-9dd5-eed2201ce179","Type":"ContainerStarted","Data":"386e440d7c017322878d877cf46e5c35f31655914d959c200d70749ad48af794"} Jul 14 13:55:06.908474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.908451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" event={"ID":"542c2330-fd10-415c-8337-ec72bded2841","Type":"ContainerStarted","Data":"b46208dace5d5c6b80bf916ce058d03299bcb34e28ba1d5a2f449867b7640a2f"} Jul 14 13:55:06.908585 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.908496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" event={"ID":"542c2330-fd10-415c-8337-ec72bded2841","Type":"ContainerStarted","Data":"36217cd5413a6b34308bd785e49871e6c10bfc02e7965c92123a3aa29ad8355a"} Jul 14 13:55:06.909555 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.909538 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" event={"ID":"0b9b574d-ae87-4cdf-813d-1a69fd80258b","Type":"ContainerStarted","Data":"fdcfe6e297bb736a28d599c847b96fe06e9b3a806e96f5f971d24d38cadd900b"} Jul 14 13:55:06.910712 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.910693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" event={"ID":"bacf787f-2d10-42b5-b088-436869d4a1fe","Type":"ContainerStarted","Data":"e376f1e78f28782a06e5c2d2e3fbdb9342f421933fd1d145e8c98c7b601efbc0"} Jul 14 13:55:06.912236 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.912216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" event={"ID":"bc1ba704-85c2-4ed5-80f2-ed62c9f02272","Type":"ContainerStarted","Data":"52a1bd90bc64b96b4af3d2252dedb4d3096a1fcdb369c6cc6c66b4b95b939748"} Jul 14 13:55:06.913513 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.913489 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" event={"ID":"5b18e5b0-77ab-486e-9250-07a2dd24cdb7","Type":"ContainerStarted","Data":"c1798bdb11c5a0905c08c5fd31d596cec6d93640d962b1817788ee7df7d42ce5"} Jul 14 13:55:06.915092 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.915069 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4nfqb" event={"ID":"6a72e177-558e-439c-a509-1dac34de6b34","Type":"ContainerStarted","Data":"f82deaad1b957c19f402c8b58a850e8f63068c53aaf0f120cb62d5073f987f16"} Jul 14 13:55:06.959053 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.958702 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4c9nv" podStartSLOduration=67.372871267 podStartE2EDuration="1m14.95868721s" totalImagesPullingTime="7.585815943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:06.925695223 +0000 UTC m=+74.993794079" watchObservedRunningTime="2026-07-14 13:55:06.95868721 +0000 UTC m=+75.026786072" Jul 14 13:55:06.959053 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.958843 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bcmrf" podStartSLOduration=38.631779555 podStartE2EDuration="43.958837392s" totalImagesPullingTime="5.327057837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:06.956541863 +0000 UTC m=+75.024640723" watchObservedRunningTime="2026-07-14 13:55:06.958837392 +0000 UTC m=+75.026936247" Jul 14 13:55:06.990800 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:06.989533 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn"] Jul 14 13:55:07.003835 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.002600 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-v48n7" podStartSLOduration=39.673035862 podStartE2EDuration="45.00258303s" totalImagesPullingTime="5.329547168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:06.995315239 +0000 UTC m=+75.063414117" watchObservedRunningTime="2026-07-14 13:55:07.00258303 +0000 UTC m=+75.070681886" Jul 14 13:55:07.004927 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.004107 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn"] Jul 14 13:55:07.004927 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.004230 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:07.007885 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.007542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-x26pz\"" Jul 14 13:55:07.007885 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.007748 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 13:55:07.027205 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.026572 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xpsp2" podStartSLOduration=17.356247428 podStartE2EDuration="29.026559906s" totalImagesPullingTime="11.670312478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 13:54:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:07.025920282 +0000 UTC m=+75.094019159" watchObservedRunningTime="2026-07-14 13:55:07.026559906 +0000 UTC m=+75.094658751" Jul 14 13:55:07.053797 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.053624 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qr87g" podStartSLOduration=33.707856437 podStartE2EDuration="39.053607167s" totalImagesPullingTime="5.34575073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:07.053033736 +0000 UTC m=+75.121132593" watchObservedRunningTime="2026-07-14 13:55:07.053607167 +0000 UTC m=+75.121706023" Jul 14 13:55:07.097639 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.097219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/613841a8-2fe6-48bf-a7fd-0fb0722b6a25-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jcxsn\" (UID: \"613841a8-2fe6-48bf-a7fd-0fb0722b6a25\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:07.200341 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.199838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/613841a8-2fe6-48bf-a7fd-0fb0722b6a25-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jcxsn\" (UID: \"613841a8-2fe6-48bf-a7fd-0fb0722b6a25\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:07.204830 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.204788 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/613841a8-2fe6-48bf-a7fd-0fb0722b6a25-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jcxsn\" (UID: \"613841a8-2fe6-48bf-a7fd-0fb0722b6a25\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:07.319238 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.318953 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:07.586313 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.586277 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn"] Jul 14 13:55:07.597541 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:07.597511 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613841a8_2fe6_48bf_a7fd_0fb0722b6a25.slice/crio-2c7a7a1259c3f050886463a95a000b937fb7af73d9852769d4c8feed7a8bcf50 WatchSource:0}: Error finding container 2c7a7a1259c3f050886463a95a000b937fb7af73d9852769d4c8feed7a8bcf50: Status 404 returned error can't find the container with id 2c7a7a1259c3f050886463a95a000b937fb7af73d9852769d4c8feed7a8bcf50 Jul 14 13:55:07.939856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:07.937951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" event={"ID":"613841a8-2fe6-48bf-a7fd-0fb0722b6a25","Type":"ContainerStarted","Data":"2c7a7a1259c3f050886463a95a000b937fb7af73d9852769d4c8feed7a8bcf50"} Jul 14 13:55:15.997757 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:15.997471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" event={"ID":"bacf787f-2d10-42b5-b088-436869d4a1fe","Type":"ContainerStarted","Data":"8ccb500e2f84726d03964a8dd2d805b6b68179346785de84edcf19bbb5f46179"} Jul 14 13:55:16.029927 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:16.029503 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d88dbf468-f4jdd" podStartSLOduration=5.523496896 podStartE2EDuration="15.029483409s" totalImagesPullingTime="9.505986513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:16.025266088 +0000 UTC m=+84.093364945" watchObservedRunningTime="2026-07-14 13:55:16.029483409 +0000 UTC m=+84.097582268" Jul 14 13:55:16.940814 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:16.940749 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qr87g" Jul 14 13:55:17.006371 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.006296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" event={"ID":"613841a8-2fe6-48bf-a7fd-0fb0722b6a25","Type":"ContainerStarted","Data":"98d9c6ffdc7d80e4cd55ef4e020b5daeb0806287f7b01987c08fc2a38b5e8db7"} Jul 14 13:55:17.007008 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.006983 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:17.008787 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.008764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc65fc57f-rg8zc" event={"ID":"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4","Type":"ContainerStarted","Data":"ebcf162bd716b3ac6f218c1d881d591a2c11d61bbf40d3b05f5cdf2592436190"} Jul 14 13:55:17.014041 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.014020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" Jul 14 13:55:17.015505 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.015475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" event={"ID":"9920b66e-45e1-4017-9031-aa4a3c622c10","Type":"ContainerStarted","Data":"18e6e91aa32b61b7add2b44aab35a5cc1ada777c7d63dc515b7a47cfafc7af95"} Jul 14 13:55:17.015582 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.015520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" event={"ID":"9920b66e-45e1-4017-9031-aa4a3c622c10","Type":"ContainerStarted","Data":"0afc34287827a24c9c56127a3f08f4811cd9ef2bfffc036f78b6c326848ff91d"} Jul 14 13:55:17.015582 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.015539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" event={"ID":"9920b66e-45e1-4017-9031-aa4a3c622c10","Type":"ContainerStarted","Data":"e3f05313e6969df677cdec0732f9f9a5d5d3b7689f5b4c2ba7d30190625d92ec"} Jul 14 13:55:17.017863 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.017811 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" event={"ID":"0b9b574d-ae87-4cdf-813d-1a69fd80258b","Type":"ContainerStarted","Data":"c870693ad6998233f448280b0140732007ebf2528e7cd9438810a06acf714bcc"} Jul 14 13:55:17.018089 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.018071 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:17.019739 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.019722 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" Jul 14 13:55:17.020168 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.020144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" event={"ID":"5b18e5b0-77ab-486e-9250-07a2dd24cdb7","Type":"ContainerStarted","Data":"3877358f1de8fda9ef2993279eb5da85148ecef8bdf570ad564cb093de87a03d"} Jul 14 13:55:17.031393 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.031344 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jcxsn" podStartSLOduration=2.686990565 podStartE2EDuration="11.031326702s" totalImagesPullingTime="8.344336137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:17.030487089 +0000 UTC m=+85.098585970" watchObservedRunningTime="2026-07-14 13:55:17.031326702 +0000 UTC m=+85.099425538" Jul 14 13:55:17.057277 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.057203 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-25l5p" podStartSLOduration=6.703860178 podStartE2EDuration="16.057175013s" totalImagesPullingTime="9.353314835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:17.056496343 +0000 UTC m=+85.124595225" watchObservedRunningTime="2026-07-14 13:55:17.057175013 +0000 UTC m=+85.125273887" Jul 14 13:55:17.079307 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.079249 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85f94ccbc7-klwc2" podStartSLOduration=6.835819435 podStartE2EDuration="16.079234312s" totalImagesPullingTime="9.243414877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:17.077054287 +0000 UTC m=+85.145153193" watchObservedRunningTime="2026-07-14 13:55:17.079234312 +0000 UTC m=+85.147333166" Jul 14 13:55:17.123283 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.123224 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfc86d9fc-wr2np" podStartSLOduration=6.875716894 podStartE2EDuration="16.123204652s" totalImagesPullingTime="9.247487758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:17.102039093 +0000 UTC m=+85.170137947" watchObservedRunningTime="2026-07-14 13:55:17.123204652 +0000 UTC m=+85.191303501" Jul 14 13:55:17.152485 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:17.152422 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc65fc57f-rg8zc" podStartSLOduration=2.991378625 podStartE2EDuration="12.152399271s" totalImagesPullingTime="9.161020646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:17.150937043 +0000 UTC m=+85.219035901" watchObservedRunningTime="2026-07-14 13:55:17.152399271 +0000 UTC m=+85.220498126" Jul 14 13:55:20.384346 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:20.384302 2574 patch_prober.go:28] interesting pod/image-registry-66d9d8bff8-7hj84 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 13:55:20.384752 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:20.384376 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" podUID="d79bd89e-e708-485a-9fef-fd373f5a87f8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 13:55:20.873828 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:20.873791 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc65fc57f-rg8zc"] Jul 14 13:55:22.464638 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.464607 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2sjvq"] Jul 14 13:55:22.643346 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.643304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.647422 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.647320 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 13:55:22.647422 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.647384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 13:55:22.647783 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.647325 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 13:55:22.647783 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.647632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 13:55:22.647783 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.647638 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krlv4\"" Jul 14 13:55:22.739178 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-root\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739178 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd5zt\" (UniqueName: \"kubernetes.io/projected/c94a869f-1cba-48f1-841f-e696f48c731c-kube-api-access-dd5zt\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-sys\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-wtmp\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c94a869f-1cba-48f1-841f-e696f48c731c-metrics-client-ca\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-tls\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.739415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.739422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-textfile\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840564 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-tls\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840762 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-textfile\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840762 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-root\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840762 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd5zt\" (UniqueName: \"kubernetes.io/projected/c94a869f-1cba-48f1-841f-e696f48c731c-kube-api-access-dd5zt\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840762 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-sys\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840762 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.840762 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841063 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-wtmp\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841063 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.840813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c94a869f-1cba-48f1-841f-e696f48c731c-metrics-client-ca\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841174 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.841058 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-textfile\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841174 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.841106 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-root\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841174 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.841121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-sys\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841397 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.841261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-wtmp\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841520 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.841470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c94a869f-1cba-48f1-841f-e696f48c731c-metrics-client-ca\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.841614 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.841582 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.843828 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.843798 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.843919 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.843873 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c94a869f-1cba-48f1-841f-e696f48c731c-node-exporter-tls\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.849367 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.849342 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd5zt\" (UniqueName: \"kubernetes.io/projected/c94a869f-1cba-48f1-841f-e696f48c731c-kube-api-access-dd5zt\") pod \"node-exporter-2sjvq\" (UID: \"c94a869f-1cba-48f1-841f-e696f48c731c\") " pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:22.888371 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.888343 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:22.957586 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:22.957553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2sjvq" Jul 14 13:55:25.539117 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:25.539081 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:26.358697 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:55:26.358667 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94a869f_1cba_48f1_841f_e696f48c731c.slice/crio-1ea1cc119e0d7c404293ebd8c78285d1a2aced928cb3ae1cf885c2876dd53960 WatchSource:0}: Error finding container 1ea1cc119e0d7c404293ebd8c78285d1a2aced928cb3ae1cf885c2876dd53960: Status 404 returned error can't find the container with id 1ea1cc119e0d7c404293ebd8c78285d1a2aced928cb3ae1cf885c2876dd53960 Jul 14 13:55:27.071824 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:27.071749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sjvq" event={"ID":"c94a869f-1cba-48f1-841f-e696f48c731c","Type":"ContainerStarted","Data":"1ea1cc119e0d7c404293ebd8c78285d1a2aced928cb3ae1cf885c2876dd53960"} Jul 14 13:55:27.073368 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:27.073344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4nfqb" event={"ID":"6a72e177-558e-439c-a509-1dac34de6b34","Type":"ContainerStarted","Data":"f8f25a8a84c9a1f7ec18a8eea5eac156489603e2df2987f2adf008c7231f33e5"} Jul 14 13:55:27.073651 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:27.073609 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:27.075232 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:27.075209 2574 patch_prober.go:28] interesting pod/downloads-68c9cbb497-4nfqb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body= Jul 14 13:55:27.075333 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:27.075263 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-4nfqb" podUID="6a72e177-558e-439c-a509-1dac34de6b34" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" Jul 14 13:55:27.092641 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:27.092565 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-4nfqb" podStartSLOduration=4.89952162 podStartE2EDuration="25.092544995s" totalImagesPullingTime="20.193023375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:27.090865244 +0000 UTC m=+95.158964092" watchObservedRunningTime="2026-07-14 13:55:27.092544995 +0000 UTC m=+95.160643850" Jul 14 13:55:28.084283 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:28.084242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sjvq" event={"ID":"c94a869f-1cba-48f1-841f-e696f48c731c","Type":"ContainerStarted","Data":"6605c77847d175b6c5873215f6fe2486141330cd1a95b0d96ff675435efdf79f"} Jul 14 13:55:28.097018 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:28.096991 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-4nfqb" Jul 14 13:55:29.004675 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:29.004630 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66d9d8bff8-7hj84"] Jul 14 13:55:29.091781 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:29.091744 2574 generic.go:356] "Generic (PLEG): container finished" podID="c94a869f-1cba-48f1-841f-e696f48c731c" containerID="6605c77847d175b6c5873215f6fe2486141330cd1a95b0d96ff675435efdf79f" exitCode=0 Jul 14 13:55:29.092246 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:29.091852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sjvq" event={"ID":"c94a869f-1cba-48f1-841f-e696f48c731c","Type":"ContainerDied","Data":"6605c77847d175b6c5873215f6fe2486141330cd1a95b0d96ff675435efdf79f"} Jul 14 13:55:29.847817 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:29.847786 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zb2bw" Jul 14 13:55:30.100075 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:30.100001 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sjvq" event={"ID":"c94a869f-1cba-48f1-841f-e696f48c731c","Type":"ContainerStarted","Data":"56f7303e5309e469ed2f621368c91c813bfc5457c6b9acfebdace188901b6dc8"} Jul 14 13:55:30.100075 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:30.100057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sjvq" event={"ID":"c94a869f-1cba-48f1-841f-e696f48c731c","Type":"ContainerStarted","Data":"5a31aa3f64462e679ede778850e9f642d53f85fa9b9232226686e1afccd9c7ef"} Jul 14 13:55:30.120371 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:30.120322 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2sjvq" podStartSLOduration=6.466140748 podStartE2EDuration="8.120287339s" totalImagesPullingTime="1.538073326s" totalInitContainerRuntime="116.073265ms" isStatefulPod=true podCreationTimestamp="2026-07-14 13:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:55:30.118567601 +0000 UTC m=+98.186666482" watchObservedRunningTime="2026-07-14 13:55:30.120287339 +0000 UTC m=+98.188386194" Jul 14 13:55:43.160395 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:43.160361 2574 generic.go:356] "Generic (PLEG): container finished" podID="df04271c-2cc2-4129-a11c-76d256b11939" containerID="101f16765c415802df121eca835719fb128b0cb8d66678e70d7d6ca4dedfade5" exitCode=0 Jul 14 13:55:43.160886 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:43.160440 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" event={"ID":"df04271c-2cc2-4129-a11c-76d256b11939","Type":"ContainerDied","Data":"101f16765c415802df121eca835719fb128b0cb8d66678e70d7d6ca4dedfade5"} Jul 14 13:55:43.160959 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:43.160897 2574 scope.go:117] "RemoveContainer" containerID="101f16765c415802df121eca835719fb128b0cb8d66678e70d7d6ca4dedfade5" Jul 14 13:55:44.167517 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:44.167486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cnd8q" event={"ID":"df04271c-2cc2-4129-a11c-76d256b11939","Type":"ContainerStarted","Data":"473163323d869a7926ec030d919be5aa1c245b5717bae8f141edd8c409e1832e"} Jul 14 13:55:45.898744 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:45.898705 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fc65fc57f-rg8zc" podUID="4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" containerName="console" containerID="cri-o://ebcf162bd716b3ac6f218c1d881d591a2c11d61bbf40d3b05f5cdf2592436190" gracePeriod=15 Jul 14 13:55:46.177411 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.177382 2574 generic.go:356] "Generic (PLEG): container finished" podID="4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" containerID="ebcf162bd716b3ac6f218c1d881d591a2c11d61bbf40d3b05f5cdf2592436190" exitCode=0 Jul 14 13:55:46.177541 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.177431 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc65fc57f-rg8zc" event={"ID":"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4","Type":"ContainerDied","Data":"ebcf162bd716b3ac6f218c1d881d591a2c11d61bbf40d3b05f5cdf2592436190"} Jul 14 13:55:46.177541 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.177464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc65fc57f-rg8zc" event={"ID":"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4","Type":"ContainerDied","Data":"a264e478956276f6be75d4f0c196c205f741c02fc733ccf516697f89b8099b7b"} Jul 14 13:55:46.177541 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.177479 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a264e478956276f6be75d4f0c196c205f741c02fc733ccf516697f89b8099b7b" Jul 14 13:55:46.178381 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.178357 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:46.248008 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.247973 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-oauth-serving-cert\") pod \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " Jul 14 13:55:46.248171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248018 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-config\") pod \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " Jul 14 13:55:46.248171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248064 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-serving-cert\") pod \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " Jul 14 13:55:46.248171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248097 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-oauth-config\") pod \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " Jul 14 13:55:46.248171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248128 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-service-ca\") pod \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " Jul 14 13:55:46.248171 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248155 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92td7\" (UniqueName: \"kubernetes.io/projected/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-kube-api-access-92td7\") pod \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\" (UID: \"4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4\") " Jul 14 13:55:46.248538 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248511 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" (UID: "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 13:55:46.248603 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248534 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-config" (OuterVolumeSpecName: "console-config") pod "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" (UID: "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 13:55:46.248603 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.248568 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-service-ca" (OuterVolumeSpecName: "service-ca") pod "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" (UID: "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 13:55:46.250545 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.250523 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" (UID: "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 13:55:46.250672 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.250525 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-kube-api-access-92td7" (OuterVolumeSpecName: "kube-api-access-92td7") pod "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" (UID: "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4"). InnerVolumeSpecName "kube-api-access-92td7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 13:55:46.250672 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.250587 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" (UID: "4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 13:55:46.349042 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.349005 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-oauth-serving-cert\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:46.349042 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.349036 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-config\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:46.349042 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.349045 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-serving-cert\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:46.349042 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.349055 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-console-oauth-config\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:46.349330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.349064 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:46.349330 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:46.349071 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92td7\" (UniqueName: \"kubernetes.io/projected/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4-kube-api-access-92td7\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:47.181974 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:47.181936 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc65fc57f-rg8zc" Jul 14 13:55:47.199915 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:47.199883 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc65fc57f-rg8zc"] Jul 14 13:55:47.208392 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:47.208307 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc65fc57f-rg8zc"] Jul 14 13:55:48.486579 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:48.486548 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" path="/var/lib/kubelet/pods/4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4/volumes" Jul 14 13:55:54.032269 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.032207 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" podUID="d79bd89e-e708-485a-9fef-fd373f5a87f8" containerName="registry" containerID="cri-o://b1f87388d83a8c644e37c08711e986713d397c85fa9065f45681e963e4f1ac33" gracePeriod=30 Jul 14 13:55:54.212119 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.212087 2574 generic.go:356] "Generic (PLEG): container finished" podID="d79bd89e-e708-485a-9fef-fd373f5a87f8" containerID="b1f87388d83a8c644e37c08711e986713d397c85fa9065f45681e963e4f1ac33" exitCode=0 Jul 14 13:55:54.212334 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.212167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" event={"ID":"d79bd89e-e708-485a-9fef-fd373f5a87f8","Type":"ContainerDied","Data":"b1f87388d83a8c644e37c08711e986713d397c85fa9065f45681e963e4f1ac33"} Jul 14 13:55:54.298670 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.298601 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:54.411388 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411357 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-installation-pull-secrets\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411388 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411388 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56j87\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-kube-api-access-56j87\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411418 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-bound-sa-token\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411444 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-certificates\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411536 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-trusted-ca\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411618 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411591 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-image-registry-private-configuration\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411832 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411629 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411832 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411685 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d79bd89e-e708-485a-9fef-fd373f5a87f8-ca-trust-extracted\") pod \"d79bd89e-e708-485a-9fef-fd373f5a87f8\" (UID: \"d79bd89e-e708-485a-9fef-fd373f5a87f8\") " Jul 14 13:55:54.411926 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411846 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 13:55:54.411979 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.411961 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-certificates\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.412352 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.412260 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 13:55:54.414031 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.413988 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 13:55:54.414133 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.414070 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-kube-api-access-56j87" (OuterVolumeSpecName: "kube-api-access-56j87") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "kube-api-access-56j87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 13:55:54.414133 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.414070 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 13:55:54.414278 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.414200 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 13:55:54.414334 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.414273 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 13:55:54.420940 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.420914 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79bd89e-e708-485a-9fef-fd373f5a87f8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d79bd89e-e708-485a-9fef-fd373f5a87f8" (UID: "d79bd89e-e708-485a-9fef-fd373f5a87f8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 13:55:54.513070 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513038 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d79bd89e-e708-485a-9fef-fd373f5a87f8-ca-trust-extracted\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.513070 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513065 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-installation-pull-secrets\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.513070 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513075 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56j87\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-kube-api-access-56j87\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.513275 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513084 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-bound-sa-token\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.513275 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513092 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d79bd89e-e708-485a-9fef-fd373f5a87f8-trusted-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.513275 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513101 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d79bd89e-e708-485a-9fef-fd373f5a87f8-image-registry-private-configuration\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:54.513275 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:54.513110 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d79bd89e-e708-485a-9fef-fd373f5a87f8-registry-tls\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 13:55:55.217713 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:55.217672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" event={"ID":"d79bd89e-e708-485a-9fef-fd373f5a87f8","Type":"ContainerDied","Data":"09d46ad76473a1a460203e8ca57d40b32723f94b21c6982d6a0dbadf06517242"} Jul 14 13:55:55.218119 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:55.217740 2574 scope.go:117] "RemoveContainer" containerID="b1f87388d83a8c644e37c08711e986713d397c85fa9065f45681e963e4f1ac33" Jul 14 13:55:55.218119 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:55.217688 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d9d8bff8-7hj84" Jul 14 13:55:55.236695 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:55.236669 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66d9d8bff8-7hj84"] Jul 14 13:55:55.240458 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:55.240432 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66d9d8bff8-7hj84"] Jul 14 13:55:56.486284 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:56.486248 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79bd89e-e708-485a-9fef-fd373f5a87f8" path="/var/lib/kubelet/pods/d79bd89e-e708-485a-9fef-fd373f5a87f8/volumes" Jul 14 13:55:58.232794 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:58.232763 2574 generic.go:356] "Generic (PLEG): container finished" podID="3b3aa349-a588-4e4c-978b-0c5b0aa27216" containerID="70a7e39cc883a9819ee4b9269ec902d6ab719ed8d861a767dbcd6fb273d703d8" exitCode=0 Jul 14 13:55:58.233154 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:58.232803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" event={"ID":"3b3aa349-a588-4e4c-978b-0c5b0aa27216","Type":"ContainerDied","Data":"70a7e39cc883a9819ee4b9269ec902d6ab719ed8d861a767dbcd6fb273d703d8"} Jul 14 13:55:58.233154 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:58.233100 2574 scope.go:117] "RemoveContainer" containerID="70a7e39cc883a9819ee4b9269ec902d6ab719ed8d861a767dbcd6fb273d703d8" Jul 14 13:55:59.239474 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:55:59.239439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l9htw" event={"ID":"3b3aa349-a588-4e4c-978b-0c5b0aa27216","Type":"ContainerStarted","Data":"14bb17f6dba077d80b30f2d246d84b7fd2a1767142e810badf191e4d4e5dd470"} Jul 14 13:56:03.260278 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:56:03.260241 2574 generic.go:356] "Generic (PLEG): container finished" podID="0a91cba6-73c0-4713-a83a-c57abdfbb80e" containerID="ce5b70be2dcafd8dc6f39ba41cc9ae65a70cf9e7168d8ddcb59d9192e7a452bd" exitCode=0 Jul 14 13:56:03.260659 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:56:03.260316 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" event={"ID":"0a91cba6-73c0-4713-a83a-c57abdfbb80e","Type":"ContainerDied","Data":"ce5b70be2dcafd8dc6f39ba41cc9ae65a70cf9e7168d8ddcb59d9192e7a452bd"} Jul 14 13:56:03.260659 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:56:03.260638 2574 scope.go:117] "RemoveContainer" containerID="ce5b70be2dcafd8dc6f39ba41cc9ae65a70cf9e7168d8ddcb59d9192e7a452bd" Jul 14 13:56:04.267072 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:56:04.267041 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6d9gd" event={"ID":"0a91cba6-73c0-4713-a83a-c57abdfbb80e","Type":"ContainerStarted","Data":"5d6e4e1d6faf29eee2bb2fd3ef2e53383973e71478d3ea0b2164fee585e0213e"} Jul 14 13:58:52.360597 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:58:52.360570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 13:58:52.368623 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:58:52.368598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 13:58:52.371782 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:58:52.371761 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 13:58:52.373166 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:58:52.373149 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 13:58:52.379733 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:58:52.379716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 13:59:30.591640 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591604 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng"] Jul 14 13:59:30.592087 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591882 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" containerName="console" Jul 14 13:59:30.592087 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591892 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" containerName="console" Jul 14 13:59:30.592087 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591911 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79bd89e-e708-485a-9fef-fd373f5a87f8" containerName="registry" Jul 14 13:59:30.592087 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591917 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79bd89e-e708-485a-9fef-fd373f5a87f8" containerName="registry" Jul 14 13:59:30.592087 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591967 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79bd89e-e708-485a-9fef-fd373f5a87f8" containerName="registry" Jul 14 13:59:30.592087 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.591978 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fa48676-70d6-4ef5-9f1a-da5ef6f29ce4" containerName="console" Jul 14 13:59:30.595036 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.595017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.597883 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.597865 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 13:59:30.598300 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.598284 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 13:59:30.598387 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.598359 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 13:59:30.598517 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.598503 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-654n7\"" Jul 14 13:59:30.598587 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.598549 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 13:59:30.611914 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.611883 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng"] Jul 14 13:59:30.745901 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.745873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.746067 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.745909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.746067 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.745933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-tmp\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.746067 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.746020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrkc\" (UniqueName: \"kubernetes.io/projected/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-kube-api-access-rtrkc\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.746220 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.746075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-manifests\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.847421 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.847339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.847421 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.847384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-tmp\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.847421 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.847416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrkc\" (UniqueName: \"kubernetes.io/projected/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-kube-api-access-rtrkc\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.847670 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.847469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-manifests\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.847670 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.847519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.847847 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.847813 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-manifests\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.849628 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.849600 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-tmp\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.849937 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.849917 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.850012 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.849947 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.855633 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.855612 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrkc\" (UniqueName: \"kubernetes.io/projected/f63c20cf-3ade-4ba8-95b6-8344ae5d900a-kube-api-access-rtrkc\") pod \"opendatahub-operator-controller-manager-6f858c8968-5c2ng\" (UID: \"f63c20cf-3ade-4ba8-95b6-8344ae5d900a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:30.905113 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:30.905092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:31.037627 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:31.037542 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng"] Jul 14 13:59:31.040019 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:59:31.039990 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63c20cf_3ade_4ba8_95b6_8344ae5d900a.slice/crio-1a16785a4242595eef751d8f3fdd583dfc5c1cde6a1872a0bd05f190e2777d17 WatchSource:0}: Error finding container 1a16785a4242595eef751d8f3fdd583dfc5c1cde6a1872a0bd05f190e2777d17: Status 404 returned error can't find the container with id 1a16785a4242595eef751d8f3fdd583dfc5c1cde6a1872a0bd05f190e2777d17 Jul 14 13:59:31.041807 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:31.041790 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 13:59:31.086579 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:31.086552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" event={"ID":"f63c20cf-3ade-4ba8-95b6-8344ae5d900a","Type":"ContainerStarted","Data":"1a16785a4242595eef751d8f3fdd583dfc5c1cde6a1872a0bd05f190e2777d17"} Jul 14 13:59:35.108117 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:35.108079 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" event={"ID":"f63c20cf-3ade-4ba8-95b6-8344ae5d900a","Type":"ContainerStarted","Data":"3f22ad78ac82a9bac4ae294875ff82c47aa4ba363e01426c3996134968c5b4ca"} Jul 14 13:59:36.114088 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:36.114055 2574 generic.go:356] "Generic (PLEG): container finished" podID="f63c20cf-3ade-4ba8-95b6-8344ae5d900a" containerID="3f22ad78ac82a9bac4ae294875ff82c47aa4ba363e01426c3996134968c5b4ca" exitCode=0 Jul 14 13:59:36.114547 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:36.114145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" event={"ID":"f63c20cf-3ade-4ba8-95b6-8344ae5d900a","Type":"ContainerDied","Data":"3f22ad78ac82a9bac4ae294875ff82c47aa4ba363e01426c3996134968c5b4ca"} Jul 14 13:59:37.121662 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:37.121627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" event={"ID":"f63c20cf-3ade-4ba8-95b6-8344ae5d900a","Type":"ContainerStarted","Data":"3dfa00523f54b0a17ca138076d49ba24de5a6ddc2ffa4d211d1a944028b7df05"} Jul 14 13:59:37.122074 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:37.121761 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:37.148282 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:37.148234 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" podStartSLOduration=2.639473115 podStartE2EDuration="7.14821771s" totalImagesPullingTime="3.47852893s" totalInitContainerRuntime="1.030215665s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:59:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:59:37.14656379 +0000 UTC m=+345.214662657" watchObservedRunningTime="2026-07-14 13:59:37.14821771 +0000 UTC m=+345.216316565" Jul 14 13:59:48.128222 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:48.128124 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f858c8968-5c2ng" Jul 14 13:59:50.275720 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.275688 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64945c8566-r56vc"] Jul 14 13:59:50.282807 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.282782 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.285164 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.285139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 13:59:50.285164 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.285154 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4kcfp\"" Jul 14 13:59:50.285350 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.285169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 13:59:50.289372 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.289330 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64945c8566-r56vc"] Jul 14 13:59:50.294180 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.294160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-tmp\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.294306 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.294226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clgp\" (UniqueName: \"kubernetes.io/projected/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-kube-api-access-4clgp\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.294369 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.294314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-tls-certs\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.394763 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.394730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-tls-certs\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.394962 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.394791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-tmp\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.394962 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.394812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4clgp\" (UniqueName: \"kubernetes.io/projected/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-kube-api-access-4clgp\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.397083 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.397060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-tmp\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.397348 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.397331 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-tls-certs\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.403837 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.403813 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clgp\" (UniqueName: \"kubernetes.io/projected/cc4010aa-4657-471f-98e2-ceccfaeb0cb1-kube-api-access-4clgp\") pod \"kube-auth-proxy-64945c8566-r56vc\" (UID: \"cc4010aa-4657-471f-98e2-ceccfaeb0cb1\") " pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.537415 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.537341 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dxmgk"] Jul 14 13:59:50.540543 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.540521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:50.542860 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.542842 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 13:59:50.543015 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.543000 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-x7lcj\"" Jul 14 13:59:50.549832 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.549809 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dxmgk"] Jul 14 13:59:50.594904 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.594866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" Jul 14 13:59:50.596308 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.596284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab715ec-4da7-4acc-9adb-c5bb77981429-cert\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:50.596427 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.596323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qqrw\" (UniqueName: \"kubernetes.io/projected/2ab715ec-4da7-4acc-9adb-c5bb77981429-kube-api-access-9qqrw\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:50.696960 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.696924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab715ec-4da7-4acc-9adb-c5bb77981429-cert\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:50.697124 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.696979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qqrw\" (UniqueName: \"kubernetes.io/projected/2ab715ec-4da7-4acc-9adb-c5bb77981429-kube-api-access-9qqrw\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:50.697124 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:59:50.697040 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 13:59:50.697124 ip-10-0-128-255 kubenswrapper[2574]: E0714 13:59:50.697109 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab715ec-4da7-4acc-9adb-c5bb77981429-cert podName:2ab715ec-4da7-4acc-9adb-c5bb77981429 nodeName:}" failed. No retries permitted until 2026-07-14 13:59:51.197086575 +0000 UTC m=+359.265185421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2ab715ec-4da7-4acc-9adb-c5bb77981429-cert") pod "odh-model-controller-7998c67dc4-dxmgk" (UID: "2ab715ec-4da7-4acc-9adb-c5bb77981429") : secret "odh-model-controller-webhook-cert" not found Jul 14 13:59:50.713477 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.713447 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qqrw\" (UniqueName: \"kubernetes.io/projected/2ab715ec-4da7-4acc-9adb-c5bb77981429-kube-api-access-9qqrw\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:50.749835 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:50.745633 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64945c8566-r56vc"] Jul 14 13:59:50.753570 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:59:50.753540 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4010aa_4657_471f_98e2_ceccfaeb0cb1.slice/crio-f10dac5ae52812c0c85167b4f36632dcdd8633a4aef219bada75b2beeb645f2f WatchSource:0}: Error finding container f10dac5ae52812c0c85167b4f36632dcdd8633a4aef219bada75b2beeb645f2f: Status 404 returned error can't find the container with id f10dac5ae52812c0c85167b4f36632dcdd8633a4aef219bada75b2beeb645f2f Jul 14 13:59:51.187890 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.187846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" event={"ID":"cc4010aa-4657-471f-98e2-ceccfaeb0cb1","Type":"ContainerStarted","Data":"f10dac5ae52812c0c85167b4f36632dcdd8633a4aef219bada75b2beeb645f2f"} Jul 14 13:59:51.201289 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.201256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab715ec-4da7-4acc-9adb-c5bb77981429-cert\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:51.203624 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.203605 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab715ec-4da7-4acc-9adb-c5bb77981429-cert\") pod \"odh-model-controller-7998c67dc4-dxmgk\" (UID: \"2ab715ec-4da7-4acc-9adb-c5bb77981429\") " pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:51.451656 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.451583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:51.455970 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.455950 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9"] Jul 14 13:59:51.459147 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.459131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.461402 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.461382 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 13:59:51.461511 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.461437 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 13:59:51.461575 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.461527 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 13:59:51.461575 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.461542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-czzr5\"" Jul 14 13:59:51.461676 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.461649 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 13:59:51.475555 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.475480 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9"] Jul 14 13:59:51.503637 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-cacerts\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.503782 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.503782 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4266f0-3282-461c-bc34-0f2f41b0120f-local-certs\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.503782 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-token\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.503782 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.503999 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.503999 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.503856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrps6\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-kube-api-access-nrps6\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.590056 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.590022 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dxmgk"] Jul 14 13:59:51.593513 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:59:51.593482 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab715ec_4da7_4acc_9adb_c5bb77981429.slice/crio-dbd3be3c8634b838bb48c3d927e334c532a322d48086b41b8741419f67244a9d WatchSource:0}: Error finding container dbd3be3c8634b838bb48c3d927e334c532a322d48086b41b8741419f67244a9d: Status 404 returned error can't find the container with id dbd3be3c8634b838bb48c3d927e334c532a322d48086b41b8741419f67244a9d Jul 14 13:59:51.604231 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4266f0-3282-461c-bc34-0f2f41b0120f-local-certs\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604331 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-token\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604331 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604331 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604482 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrps6\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-kube-api-access-nrps6\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604482 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-cacerts\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604482 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.604960 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.604936 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.606809 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.606790 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.606909 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.606813 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.606968 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.606931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4266f0-3282-461c-bc34-0f2f41b0120f-local-certs\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.607103 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.607083 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-cacerts\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.612856 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.612838 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-token\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.613089 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.613070 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrps6\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-kube-api-access-nrps6\") pod \"istiod-openshift-gateway-7574459656-dfjg9\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.790776 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.790693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:51.939656 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:51.939624 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9"] Jul 14 13:59:51.941833 ip-10-0-128-255 kubenswrapper[2574]: W0714 13:59:51.941790 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4266f0_3282_461c_bc34_0f2f41b0120f.slice/crio-89d95e55ec91f8e1d4ef0a5380d19b33004ba60cfa6c41f71d9b8a8b17c5438f WatchSource:0}: Error finding container 89d95e55ec91f8e1d4ef0a5380d19b33004ba60cfa6c41f71d9b8a8b17c5438f: Status 404 returned error can't find the container with id 89d95e55ec91f8e1d4ef0a5380d19b33004ba60cfa6c41f71d9b8a8b17c5438f Jul 14 13:59:52.193793 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:52.193751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" event={"ID":"2ab715ec-4da7-4acc-9adb-c5bb77981429","Type":"ContainerStarted","Data":"dbd3be3c8634b838bb48c3d927e334c532a322d48086b41b8741419f67244a9d"} Jul 14 13:59:52.195080 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:52.195055 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" event={"ID":"6f4266f0-3282-461c-bc34-0f2f41b0120f","Type":"ContainerStarted","Data":"89d95e55ec91f8e1d4ef0a5380d19b33004ba60cfa6c41f71d9b8a8b17c5438f"} Jul 14 13:59:55.104681 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:55.104654 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 13:59:55.213225 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:55.213165 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" event={"ID":"cc4010aa-4657-471f-98e2-ceccfaeb0cb1","Type":"ContainerStarted","Data":"c5138e27335ca47aec4f4b82781ce81bbdbd6d83c785588ac4ca606deb1043ef"} Jul 14 13:59:55.216575 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:55.216544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" event={"ID":"2ab715ec-4da7-4acc-9adb-c5bb77981429","Type":"ContainerStarted","Data":"ba5c81b5c02d221e7b961aba606b16707e4eb4f624b377eb2ca230ed1a3fc5d2"} Jul 14 13:59:55.217092 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:55.217073 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 13:59:55.232639 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:55.232587 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64945c8566-r56vc" podStartSLOduration=0.886157719 podStartE2EDuration="5.232569526s" totalImagesPullingTime="4.346411807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:59:55.23103287 +0000 UTC m=+363.299131749" watchObservedRunningTime="2026-07-14 13:59:55.232569526 +0000 UTC m=+363.300668405" Jul 14 13:59:55.246594 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:55.246311 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" podStartSLOduration=1.737844484 podStartE2EDuration="5.246293135s" totalImagesPullingTime="3.508448651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:59:55.245665556 +0000 UTC m=+363.313764413" watchObservedRunningTime="2026-07-14 13:59:55.246293135 +0000 UTC m=+363.314391990" Jul 14 13:59:56.516539 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:56.516496 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 13:59:56.516775 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:56.516606 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 13:59:57.230197 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:57.230150 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" event={"ID":"6f4266f0-3282-461c-bc34-0f2f41b0120f","Type":"ContainerStarted","Data":"7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db"} Jul 14 13:59:57.230923 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:57.230893 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 13:59:57.232276 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:57.232243 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-dfjg9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 13:59:57.232387 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:57.232297 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" podUID="6f4266f0-3282-461c-bc34-0f2f41b0120f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 13:59:57.262007 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:57.261941 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" podStartSLOduration=1.6901714490000002 podStartE2EDuration="6.261921096s" totalImagesPullingTime="4.571749647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 13:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 13:59:57.260972759 +0000 UTC m=+365.329071635" watchObservedRunningTime="2026-07-14 13:59:57.261921096 +0000 UTC m=+365.330019953" Jul 14 13:59:58.236043 ip-10-0-128-255 kubenswrapper[2574]: I0714 13:59:58.236011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 14:00:01.468152 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.468114 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9"] Jul 14 14:00:01.471203 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.471165 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:01.473622 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.473596 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 14:00:01.473738 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.473602 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wmcb8\"" Jul 14 14:00:01.483391 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.483368 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9"] Jul 14 14:00:01.494252 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.494222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5xt\" (UniqueName: \"kubernetes.io/projected/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-kube-api-access-xl5xt\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:01.494384 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.494267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:01.595317 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.595280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5xt\" (UniqueName: \"kubernetes.io/projected/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-kube-api-access-xl5xt\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:01.595517 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.595323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:01.595583 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:00:01.595507 2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 14:00:01.595638 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:00:01.595594 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert podName:eceaf50f-5d6b-47f3-a34c-37ad444f4cc1 nodeName:}" failed. No retries permitted until 2026-07-14 14:00:02.095572954 +0000 UTC m=+370.163671802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert") pod "kserve-controller-manager-d6f4b65b8-g2dj9" (UID: "eceaf50f-5d6b-47f3-a34c-37ad444f4cc1") : secret "kserve-webhook-server-cert" not found Jul 14 14:00:01.604544 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:01.604521 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5xt\" (UniqueName: \"kubernetes.io/projected/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-kube-api-access-xl5xt\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:02.101350 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:02.101310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:02.101518 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:00:02.101445 2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 14:00:02.101559 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:00:02.101534 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert podName:eceaf50f-5d6b-47f3-a34c-37ad444f4cc1 nodeName:}" failed. No retries permitted until 2026-07-14 14:00:03.101515559 +0000 UTC m=+371.169614399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert") pod "kserve-controller-manager-d6f4b65b8-g2dj9" (UID: "eceaf50f-5d6b-47f3-a34c-37ad444f4cc1") : secret "kserve-webhook-server-cert" not found Jul 14 14:00:03.110752 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.110718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:03.113043 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.113017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eceaf50f-5d6b-47f3-a34c-37ad444f4cc1-cert\") pod \"kserve-controller-manager-d6f4b65b8-g2dj9\" (UID: \"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:03.179626 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.179596 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9"] Jul 14 14:00:03.179769 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.179755 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" podUID="6f4266f0-3282-461c-bc34-0f2f41b0120f" containerName="discovery" containerID="cri-o://7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db" gracePeriod=30 Jul 14 14:00:03.284705 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.284672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:03.436373 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.436349 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 14:00:03.439129 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.439108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9"] Jul 14 14:00:03.440807 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:00:03.440787 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeceaf50f_5d6b_47f3_a34c_37ad444f4cc1.slice/crio-579af2fe42befbc31fafc33f225cc92b81a992cb428a76d711e0c0114fec726b WatchSource:0}: Error finding container 579af2fe42befbc31fafc33f225cc92b81a992cb428a76d711e0c0114fec726b: Status 404 returned error can't find the container with id 579af2fe42befbc31fafc33f225cc92b81a992cb428a76d711e0c0114fec726b Jul 14 14:00:03.514076 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514045 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4266f0-3282-461c-bc34-0f2f41b0120f-local-certs\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514262 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514095 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-cacerts\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514262 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514127 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-ca-configmap\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514262 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514174 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-dns-cert\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514511 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514309 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-kubeconfig\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514511 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514361 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-token\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514511 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514385 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrps6\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-kube-api-access-nrps6\") pod \"6f4266f0-3282-461c-bc34-0f2f41b0120f\" (UID: \"6f4266f0-3282-461c-bc34-0f2f41b0120f\") " Jul 14 14:00:03.514665 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514538 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:00:03.514729 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.514692 2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-ca-configmap\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:03.516750 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.516722 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-cacerts" (OuterVolumeSpecName: "cacerts") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:00:03.516859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.516772 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:00:03.516859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.516813 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4266f0-3282-461c-bc34-0f2f41b0120f-local-certs" (OuterVolumeSpecName: "local-certs") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:00:03.516859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.516826 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:00:03.517007 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.516986 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-kube-api-access-nrps6" (OuterVolumeSpecName: "kube-api-access-nrps6") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "kube-api-access-nrps6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:00:03.517050 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.517024 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f4266f0-3282-461c-bc34-0f2f41b0120f" (UID: "6f4266f0-3282-461c-bc34-0f2f41b0120f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:00:03.615960 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.615922 2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4266f0-3282-461c-bc34-0f2f41b0120f-local-certs\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:03.615960 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.615953 2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-cacerts\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:03.615960 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.615962 2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-csr-dns-cert\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:03.616220 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.615971 2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-kubeconfig\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:03.616220 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.615979 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-istio-token\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:03.616220 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:03.615987 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrps6\" (UniqueName: \"kubernetes.io/projected/6f4266f0-3282-461c-bc34-0f2f41b0120f-kube-api-access-nrps6\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:04.262083 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.262048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" event={"ID":"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1","Type":"ContainerStarted","Data":"579af2fe42befbc31fafc33f225cc92b81a992cb428a76d711e0c0114fec726b"} Jul 14 14:00:04.263388 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.263365 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f4266f0-3282-461c-bc34-0f2f41b0120f" containerID="7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db" exitCode=0 Jul 14 14:00:04.263496 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.263410 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" Jul 14 14:00:04.263496 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.263456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" event={"ID":"6f4266f0-3282-461c-bc34-0f2f41b0120f","Type":"ContainerDied","Data":"7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db"} Jul 14 14:00:04.263612 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.263509 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9" event={"ID":"6f4266f0-3282-461c-bc34-0f2f41b0120f","Type":"ContainerDied","Data":"89d95e55ec91f8e1d4ef0a5380d19b33004ba60cfa6c41f71d9b8a8b17c5438f"} Jul 14 14:00:04.263612 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.263538 2574 scope.go:117] "RemoveContainer" containerID="7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db" Jul 14 14:00:04.272222 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.272204 2574 scope.go:117] "RemoveContainer" containerID="7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db" Jul 14 14:00:04.272478 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:00:04.272458 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db\": container with ID starting with 7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db not found: ID does not exist" containerID="7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db" Jul 14 14:00:04.272528 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.272487 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db"} err="failed to get container status \"7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db\": rpc error: code = NotFound desc = could not find container \"7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db\": container with ID starting with 7884bfb2985b87da7895681af64b15881b47c2630930c4f44eb7ac47912e37db not found: ID does not exist" Jul 14 14:00:04.290757 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.290733 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9"] Jul 14 14:00:04.293208 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.293169 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dfjg9"] Jul 14 14:00:04.486813 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:04.486785 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4266f0-3282-461c-bc34-0f2f41b0120f" path="/var/lib/kubelet/pods/6f4266f0-3282-461c-bc34-0f2f41b0120f/volumes" Jul 14 14:00:07.232325 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:07.232298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dxmgk" Jul 14 14:00:07.282730 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:07.282659 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" event={"ID":"eceaf50f-5d6b-47f3-a34c-37ad444f4cc1","Type":"ContainerStarted","Data":"d60309582d5614e336f580b0b71ac33a4094d70ddfe372f70416eea9afdb9b31"} Jul 14 14:00:07.282914 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:07.282751 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:07.304778 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:07.304728 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" podStartSLOduration=3.027051873 podStartE2EDuration="6.304711526s" totalImagesPullingTime="3.277659653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:00:07.304404677 +0000 UTC m=+375.372503559" watchObservedRunningTime="2026-07-14 14:00:07.304711526 +0000 UTC m=+375.372810381" Jul 14 14:00:38.293118 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:38.293085 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g2dj9" Jul 14 14:00:51.623791 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.623756 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9l6c9"] Jul 14 14:00:51.624177 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.624157 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4266f0-3282-461c-bc34-0f2f41b0120f" containerName="discovery" Jul 14 14:00:51.624177 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.624196 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4266f0-3282-461c-bc34-0f2f41b0120f" containerName="discovery" Jul 14 14:00:51.624301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.624289 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4266f0-3282-461c-bc34-0f2f41b0120f" containerName="discovery" Jul 14 14:00:51.627430 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.627407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:51.629674 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.629650 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8bftt\"" Jul 14 14:00:51.629789 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.629726 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 14:00:51.629789 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.629727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 14:00:51.636834 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.636811 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9l6c9"] Jul 14 14:00:51.720481 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.720449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hd5\" (UniqueName: \"kubernetes.io/projected/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6-kube-api-access-r5hd5\") pod \"kuadrant-operator-catalog-9l6c9\" (UID: \"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6\") " pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:51.821396 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.821360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hd5\" (UniqueName: \"kubernetes.io/projected/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6-kube-api-access-r5hd5\") pod \"kuadrant-operator-catalog-9l6c9\" (UID: \"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6\") " pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:51.834763 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.834735 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hd5\" (UniqueName: \"kubernetes.io/projected/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6-kube-api-access-r5hd5\") pod \"kuadrant-operator-catalog-9l6c9\" (UID: \"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6\") " pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:51.938621 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.938577 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:51.989290 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:51.989248 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9l6c9"] Jul 14 14:00:52.077120 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.077063 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9l6c9"] Jul 14 14:00:52.084878 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:00:52.084851 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a34a9cb_151d_4563_b6bb_6e030ca5b3b6.slice/crio-8bdbe01d42faaeec56b9a2a9c57518ab3d2bbc3e9f07552778f3d982846d2c8d WatchSource:0}: Error finding container 8bdbe01d42faaeec56b9a2a9c57518ab3d2bbc3e9f07552778f3d982846d2c8d: Status 404 returned error can't find the container with id 8bdbe01d42faaeec56b9a2a9c57518ab3d2bbc3e9f07552778f3d982846d2c8d Jul 14 14:00:52.207084 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.206999 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlmh5"] Jul 14 14:00:52.228210 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.227830 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:00:52.236623 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.232976 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlmh5"] Jul 14 14:00:52.328081 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.328041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcdcq\" (UniqueName: \"kubernetes.io/projected/158086bd-2e57-4893-afda-2b558ae144e5-kube-api-access-hcdcq\") pod \"kuadrant-operator-catalog-vlmh5\" (UID: \"158086bd-2e57-4893-afda-2b558ae144e5\") " pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:00:52.429135 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.429106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcdcq\" (UniqueName: \"kubernetes.io/projected/158086bd-2e57-4893-afda-2b558ae144e5-kube-api-access-hcdcq\") pod \"kuadrant-operator-catalog-vlmh5\" (UID: \"158086bd-2e57-4893-afda-2b558ae144e5\") " pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:00:52.438773 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.438753 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcdcq\" (UniqueName: \"kubernetes.io/projected/158086bd-2e57-4893-afda-2b558ae144e5-kube-api-access-hcdcq\") pod \"kuadrant-operator-catalog-vlmh5\" (UID: \"158086bd-2e57-4893-afda-2b558ae144e5\") " pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:00:52.480031 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.479957 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" event={"ID":"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6","Type":"ContainerStarted","Data":"8bdbe01d42faaeec56b9a2a9c57518ab3d2bbc3e9f07552778f3d982846d2c8d"} Jul 14 14:00:52.543204 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.543146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:00:52.692656 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:52.692630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vlmh5"] Jul 14 14:00:52.694951 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:00:52.694928 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158086bd_2e57_4893_afda_2b558ae144e5.slice/crio-784d334ab923a546dd55aa6803440978ce5e7cf20ce7ebc8f29fbf4c097be145 WatchSource:0}: Error finding container 784d334ab923a546dd55aa6803440978ce5e7cf20ce7ebc8f29fbf4c097be145: Status 404 returned error can't find the container with id 784d334ab923a546dd55aa6803440978ce5e7cf20ce7ebc8f29fbf4c097be145 Jul 14 14:00:53.485130 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:53.485098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" event={"ID":"158086bd-2e57-4893-afda-2b558ae144e5","Type":"ContainerStarted","Data":"784d334ab923a546dd55aa6803440978ce5e7cf20ce7ebc8f29fbf4c097be145"} Jul 14 14:00:56.502120 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.502072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" event={"ID":"158086bd-2e57-4893-afda-2b558ae144e5","Type":"ContainerStarted","Data":"986ad5a3daa974e7b58ac5fbc88399943cd189fd0b1f8654891e84bb9b357fb7"} Jul 14 14:00:56.503518 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.503492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" event={"ID":"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6","Type":"ContainerStarted","Data":"d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e"} Jul 14 14:00:56.503616 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.503563 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" podUID="5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" containerName="registry-server" containerID="cri-o://d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e" gracePeriod=2 Jul 14 14:00:56.519747 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.519706 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" podStartSLOduration=1.522722635 podStartE2EDuration="4.519691942s" totalImagesPullingTime="2.996969307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:00:56.518822508 +0000 UTC m=+424.586921362" watchObservedRunningTime="2026-07-14 14:00:56.519691942 +0000 UTC m=+424.587790796" Jul 14 14:00:56.535711 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.535673 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" podStartSLOduration=1.925195886 podStartE2EDuration="5.535659893s" totalImagesPullingTime="3.610464007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:00:56.534418648 +0000 UTC m=+424.602517531" watchObservedRunningTime="2026-07-14 14:00:56.535659893 +0000 UTC m=+424.603758747" Jul 14 14:00:56.752717 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.752655 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:56.866715 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.866682 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5hd5\" (UniqueName: \"kubernetes.io/projected/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6-kube-api-access-r5hd5\") pod \"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6\" (UID: \"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6\") " Jul 14 14:00:56.868817 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.868794 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6-kube-api-access-r5hd5" (OuterVolumeSpecName: "kube-api-access-r5hd5") pod "5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" (UID: "5a34a9cb-151d-4563-b6bb-6e030ca5b3b6"). InnerVolumeSpecName "kube-api-access-r5hd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:00:56.967387 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:56.967362 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5hd5\" (UniqueName: \"kubernetes.io/projected/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6-kube-api-access-r5hd5\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:00:57.509464 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.509426 2574 generic.go:356] "Generic (PLEG): container finished" podID="5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" containerID="d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e" exitCode=0 Jul 14 14:00:57.509464 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.509467 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" Jul 14 14:00:57.509912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.509512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" event={"ID":"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6","Type":"ContainerDied","Data":"d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e"} Jul 14 14:00:57.509912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.509573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9l6c9" event={"ID":"5a34a9cb-151d-4563-b6bb-6e030ca5b3b6","Type":"ContainerDied","Data":"8bdbe01d42faaeec56b9a2a9c57518ab3d2bbc3e9f07552778f3d982846d2c8d"} Jul 14 14:00:57.509912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.509607 2574 scope.go:117] "RemoveContainer" containerID="d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e" Jul 14 14:00:57.519172 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.519156 2574 scope.go:117] "RemoveContainer" containerID="d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e" Jul 14 14:00:57.519412 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:00:57.519395 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e\": container with ID starting with d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e not found: ID does not exist" containerID="d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e" Jul 14 14:00:57.519451 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.519421 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e"} err="failed to get container status \"d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e\": rpc error: code = NotFound desc = could not find container \"d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e\": container with ID starting with d58b2d0b59bd58609119d9525d48698cd6f3ebc68b8c6be45d444de47191d71e not found: ID does not exist" Jul 14 14:00:57.531009 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.530976 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9l6c9"] Jul 14 14:00:57.536708 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:57.536690 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9l6c9"] Jul 14 14:00:58.486371 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:00:58.486338 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" path="/var/lib/kubelet/pods/5a34a9cb-151d-4563-b6bb-6e030ca5b3b6/volumes" Jul 14 14:01:02.543301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:02.543267 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:01:02.543870 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:02.543322 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:01:02.567554 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:02.567524 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:01:03.559647 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:03.559619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vlmh5" Jul 14 14:01:24.299749 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.299670 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq"] Jul 14 14:01:24.300118 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.300045 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" containerName="registry-server" Jul 14 14:01:24.300118 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.300057 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" containerName="registry-server" Jul 14 14:01:24.300219 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.300130 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a34a9cb-151d-4563-b6bb-6e030ca5b3b6" containerName="registry-server" Jul 14 14:01:24.303236 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.303216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:24.305520 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.305497 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f4grq\"" Jul 14 14:01:24.311953 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.311932 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq"] Jul 14 14:01:24.390547 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.390512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnwzc\" (UniqueName: \"kubernetes.io/projected/0ad97bb3-9af1-4b2b-8891-bcd672751dfb-kube-api-access-mnwzc\") pod \"authorino-operator-75cc8d5cb7-2gqtq\" (UID: \"0ad97bb3-9af1-4b2b-8891-bcd672751dfb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:24.491670 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.491636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnwzc\" (UniqueName: \"kubernetes.io/projected/0ad97bb3-9af1-4b2b-8891-bcd672751dfb-kube-api-access-mnwzc\") pod \"authorino-operator-75cc8d5cb7-2gqtq\" (UID: \"0ad97bb3-9af1-4b2b-8891-bcd672751dfb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:24.500352 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.500330 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnwzc\" (UniqueName: \"kubernetes.io/projected/0ad97bb3-9af1-4b2b-8891-bcd672751dfb-kube-api-access-mnwzc\") pod \"authorino-operator-75cc8d5cb7-2gqtq\" (UID: \"0ad97bb3-9af1-4b2b-8891-bcd672751dfb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:24.613391 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.613306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:24.746902 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:24.746874 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq"] Jul 14 14:01:24.749623 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:24.749595 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad97bb3_9af1_4b2b_8891_bcd672751dfb.slice/crio-252ee9d7ea3fd1f45505ff3b5bb8c67fadee9936593887aa54df959333763bda WatchSource:0}: Error finding container 252ee9d7ea3fd1f45505ff3b5bb8c67fadee9936593887aa54df959333763bda: Status 404 returned error can't find the container with id 252ee9d7ea3fd1f45505ff3b5bb8c67fadee9936593887aa54df959333763bda Jul 14 14:01:25.637592 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:25.637560 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" event={"ID":"0ad97bb3-9af1-4b2b-8891-bcd672751dfb","Type":"ContainerStarted","Data":"252ee9d7ea3fd1f45505ff3b5bb8c67fadee9936593887aa54df959333763bda"} Jul 14 14:01:27.351655 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.351629 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl"] Jul 14 14:01:27.354840 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.354820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:27.359708 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.359686 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2mppg\"" Jul 14 14:01:27.368383 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.368350 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl"] Jul 14 14:01:27.427224 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.427163 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq276\" (UniqueName: \"kubernetes.io/projected/ab9e2093-7b97-49da-a3c7-e20b6b50dd76-kube-api-access-cq276\") pod \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" (UID: \"ab9e2093-7b97-49da-a3c7-e20b6b50dd76\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:27.528053 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.528012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq276\" (UniqueName: \"kubernetes.io/projected/ab9e2093-7b97-49da-a3c7-e20b6b50dd76-kube-api-access-cq276\") pod \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" (UID: \"ab9e2093-7b97-49da-a3c7-e20b6b50dd76\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:27.537403 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.537376 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq276\" (UniqueName: \"kubernetes.io/projected/ab9e2093-7b97-49da-a3c7-e20b6b50dd76-kube-api-access-cq276\") pod \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" (UID: \"ab9e2093-7b97-49da-a3c7-e20b6b50dd76\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:27.649014 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.648930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" event={"ID":"0ad97bb3-9af1-4b2b-8891-bcd672751dfb","Type":"ContainerStarted","Data":"2c5ffe847bbedbb7b0794f3aea8a8a4bf65cd378251f303b89b0168c60c0bcb1"} Jul 14 14:01:27.649151 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.649035 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:27.665387 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.665364 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:27.667664 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.667623 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" podStartSLOduration=1.126535919 podStartE2EDuration="3.667610293s" totalImagesPullingTime="2.541074374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:27.666992838 +0000 UTC m=+455.735091719" watchObservedRunningTime="2026-07-14 14:01:27.667610293 +0000 UTC m=+455.735709147" Jul 14 14:01:27.803999 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:27.803975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl"] Jul 14 14:01:27.806106 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:27.806075 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9e2093_7b97_49da_a3c7_e20b6b50dd76.slice/crio-209c769beb1e8d06ebc4ae8553873aec66d78a92686025d2fad177e97a37c7eb WatchSource:0}: Error finding container 209c769beb1e8d06ebc4ae8553873aec66d78a92686025d2fad177e97a37c7eb: Status 404 returned error can't find the container with id 209c769beb1e8d06ebc4ae8553873aec66d78a92686025d2fad177e97a37c7eb Jul 14 14:01:28.654932 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:28.654901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" event={"ID":"ab9e2093-7b97-49da-a3c7-e20b6b50dd76","Type":"ContainerStarted","Data":"209c769beb1e8d06ebc4ae8553873aec66d78a92686025d2fad177e97a37c7eb"} Jul 14 14:01:30.666625 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:30.666587 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" event={"ID":"ab9e2093-7b97-49da-a3c7-e20b6b50dd76","Type":"ContainerStarted","Data":"8a9d6a306d9b1d79300888b07651125ccb28ed08dab7d3cad61521e9d2110b4c"} Jul 14 14:01:30.667083 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:30.666738 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:30.704683 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:30.704632 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" podStartSLOduration=1.549461505 podStartE2EDuration="3.704617554s" totalImagesPullingTime="2.155156049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:30.70239768 +0000 UTC m=+458.770496559" watchObservedRunningTime="2026-07-14 14:01:30.704617554 +0000 UTC m=+458.772716408" Jul 14 14:01:32.394505 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.394469 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp"] Jul 14 14:01:32.397859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.397842 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.400592 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.400571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kzqv7\"" Jul 14 14:01:32.412704 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.412675 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp"] Jul 14 14:01:32.574160 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.574129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.574334 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.574179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgdn7\" (UniqueName: \"kubernetes.io/projected/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-kube-api-access-sgdn7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.674646 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.674614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.674819 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.674667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgdn7\" (UniqueName: \"kubernetes.io/projected/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-kube-api-access-sgdn7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.675231 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.675179 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.683786 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.683759 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgdn7\" (UniqueName: \"kubernetes.io/projected/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-kube-api-access-sgdn7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.707740 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.707720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:32.846581 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:32.846552 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp"] Jul 14 14:01:32.848236 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:32.848205 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eeb9d16_f063_4cdc_ad3a_cab919ba7173.slice/crio-d0928abf52b8f0cbece0d8c2c1a877d20e5789532d8055a0e5fec4e76a1dab7f WatchSource:0}: Error finding container d0928abf52b8f0cbece0d8c2c1a877d20e5789532d8055a0e5fec4e76a1dab7f: Status 404 returned error can't find the container with id d0928abf52b8f0cbece0d8c2c1a877d20e5789532d8055a0e5fec4e76a1dab7f Jul 14 14:01:33.681967 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:33.681933 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" event={"ID":"9eeb9d16-f063-4cdc-ad3a-cab919ba7173","Type":"ContainerStarted","Data":"d0928abf52b8f0cbece0d8c2c1a877d20e5789532d8055a0e5fec4e76a1dab7f"} Jul 14 14:01:35.069521 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.069482 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7"] Jul 14 14:01:35.073042 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.073019 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:35.075783 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.075763 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z6pdv\"" Jul 14 14:01:35.076406 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.076390 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 14:01:35.095642 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.095614 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7"] Jul 14 14:01:35.199779 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.199746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg2bk\" (UniqueName: \"kubernetes.io/projected/408e2bda-64c1-497f-be5c-034440bab509-kube-api-access-qg2bk\") pod \"dns-operator-controller-manager-864dd78c4c-xmpr7\" (UID: \"408e2bda-64c1-497f-be5c-034440bab509\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:35.300334 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.300302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg2bk\" (UniqueName: \"kubernetes.io/projected/408e2bda-64c1-497f-be5c-034440bab509-kube-api-access-qg2bk\") pod \"dns-operator-controller-manager-864dd78c4c-xmpr7\" (UID: \"408e2bda-64c1-497f-be5c-034440bab509\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:35.315435 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.315400 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg2bk\" (UniqueName: \"kubernetes.io/projected/408e2bda-64c1-497f-be5c-034440bab509-kube-api-access-qg2bk\") pod \"dns-operator-controller-manager-864dd78c4c-xmpr7\" (UID: \"408e2bda-64c1-497f-be5c-034440bab509\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:35.384102 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.384016 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:35.528239 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.528208 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7"] Jul 14 14:01:35.530084 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:35.530056 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408e2bda_64c1_497f_be5c_034440bab509.slice/crio-31bac444b66e43b8b6c0d48656f86457b60f8bf3b38c94f569cc998007898f99 WatchSource:0}: Error finding container 31bac444b66e43b8b6c0d48656f86457b60f8bf3b38c94f569cc998007898f99: Status 404 returned error can't find the container with id 31bac444b66e43b8b6c0d48656f86457b60f8bf3b38c94f569cc998007898f99 Jul 14 14:01:35.693809 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:35.693768 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" event={"ID":"408e2bda-64c1-497f-be5c-034440bab509","Type":"ContainerStarted","Data":"31bac444b66e43b8b6c0d48656f86457b60f8bf3b38c94f569cc998007898f99"} Jul 14 14:01:38.658418 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:38.658347 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2gqtq" Jul 14 14:01:38.711890 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:38.711847 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" event={"ID":"408e2bda-64c1-497f-be5c-034440bab509","Type":"ContainerStarted","Data":"a479cef52afb9b1c812f8cd03652a0613e1a38c65fc068bca695d4c75e7406e2"} Jul 14 14:01:38.712089 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:38.712059 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:38.732819 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:38.732771 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" podStartSLOduration=0.873338754 podStartE2EDuration="3.732754679s" totalImagesPullingTime="2.859415925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:38.73085527 +0000 UTC m=+466.798954146" watchObservedRunningTime="2026-07-14 14:01:38.732754679 +0000 UTC m=+466.800853535" Jul 14 14:01:40.725201 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:40.725144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" event={"ID":"9eeb9d16-f063-4cdc-ad3a-cab919ba7173","Type":"ContainerStarted","Data":"9620203103d205e2b066e127d62451e4db729a0fea4bc7972f4333e2342773b5"} Jul 14 14:01:40.725613 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:40.725293 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:40.760379 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:40.760328 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" podStartSLOduration=1.7787129560000001 podStartE2EDuration="8.760312524s" totalImagesPullingTime="6.981599568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:40.758369102 +0000 UTC m=+468.826467969" watchObservedRunningTime="2026-07-14 14:01:40.760312524 +0000 UTC m=+468.828411379" Jul 14 14:01:41.673898 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:41.673865 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:49.720743 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:49.720713 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xmpr7" Jul 14 14:01:51.736417 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:51.736385 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:52.340527 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.340494 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544dd75647-46zln"] Jul 14 14:01:52.342822 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.342800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.346101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.346075 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 14:01:52.346231 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.346173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qrpw7\"" Jul 14 14:01:52.346444 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.346430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 14:01:52.346527 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.346445 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 14:01:52.346527 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.346463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 14:01:52.346620 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.346560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 14:01:52.351000 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.350981 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 14:01:52.355570 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.355536 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544dd75647-46zln"] Jul 14 14:01:52.404368 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.404338 2574 scope.go:117] "RemoveContainer" containerID="ebcf162bd716b3ac6f218c1d881d591a2c11d61bbf40d3b05f5cdf2592436190" Jul 14 14:01:52.442172 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-oauth-serving-cert\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.442290 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442173 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-oauth-config\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.442290 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-serving-cert\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.442290 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-service-ca\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.442396 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq6dt\" (UniqueName: \"kubernetes.io/projected/ba7e9265-66f7-4e18-abb9-a8f72c77d298-kube-api-access-xq6dt\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.442396 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-config\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.442454 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.442405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-trusted-ca-bundle\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.542764 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.542738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-config\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.542890 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.542772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-trusted-ca-bundle\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.542890 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.542823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-oauth-serving-cert\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.542986 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.542909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-oauth-config\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.542986 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.542943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-serving-cert\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.542986 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.542972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-service-ca\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.543123 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.543002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq6dt\" (UniqueName: \"kubernetes.io/projected/ba7e9265-66f7-4e18-abb9-a8f72c77d298-kube-api-access-xq6dt\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.543612 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.543578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-config\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.543612 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.543578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-oauth-serving-cert\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.543791 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.543771 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-service-ca\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.543836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.543799 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba7e9265-66f7-4e18-abb9-a8f72c77d298-trusted-ca-bundle\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.545509 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.545480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-oauth-config\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.545633 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.545524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7e9265-66f7-4e18-abb9-a8f72c77d298-console-serving-cert\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.557821 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.557798 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq6dt\" (UniqueName: \"kubernetes.io/projected/ba7e9265-66f7-4e18-abb9-a8f72c77d298-kube-api-access-xq6dt\") pod \"console-544dd75647-46zln\" (UID: \"ba7e9265-66f7-4e18-abb9-a8f72c77d298\") " pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.653383 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.653320 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544dd75647-46zln" Jul 14 14:01:52.787084 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.787060 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544dd75647-46zln"] Jul 14 14:01:52.788735 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:52.788708 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7e9265_66f7_4e18_abb9_a8f72c77d298.slice/crio-079d3ab47ebabcd77a4b94e36945bd0c6f83471c574c563eb3ba80edfd21bc57 WatchSource:0}: Error finding container 079d3ab47ebabcd77a4b94e36945bd0c6f83471c574c563eb3ba80edfd21bc57: Status 404 returned error can't find the container with id 079d3ab47ebabcd77a4b94e36945bd0c6f83471c574c563eb3ba80edfd21bc57 Jul 14 14:01:52.905283 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.905258 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6"] Jul 14 14:01:52.907463 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.907442 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:52.929535 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.929500 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6"] Jul 14 14:01:52.947597 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.947565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:52.947745 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:52.947636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flf59\" (UniqueName: \"kubernetes.io/projected/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-kube-api-access-flf59\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.049050 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.049015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flf59\" (UniqueName: \"kubernetes.io/projected/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-kube-api-access-flf59\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.049263 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.049112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.049495 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.049476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.058495 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.058472 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flf59\" (UniqueName: \"kubernetes.io/projected/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-kube-api-access-flf59\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.217295 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.217201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.354973 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.354913 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6"] Jul 14 14:01:53.357226 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:53.357196 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b8fd54_2c4f_41c6_b2bd_8cc68851fccd.slice/crio-a86f450b07aee35dfa1501d7fb1a970373b5ccd6e7b41d49dd6b5e0a3a5ea224 WatchSource:0}: Error finding container a86f450b07aee35dfa1501d7fb1a970373b5ccd6e7b41d49dd6b5e0a3a5ea224: Status 404 returned error can't find the container with id a86f450b07aee35dfa1501d7fb1a970373b5ccd6e7b41d49dd6b5e0a3a5ea224 Jul 14 14:01:53.595870 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.595796 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6"] Jul 14 14:01:53.602742 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.602705 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6"] Jul 14 14:01:53.613399 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.613367 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp"] Jul 14 14:01:53.613573 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.613537 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" containerName="manager" containerID="cri-o://9620203103d205e2b066e127d62451e4db729a0fea4bc7972f4333e2342773b5" gracePeriod=2 Jul 14 14:01:53.629115 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.628789 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp"] Jul 14 14:01:53.630877 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.630849 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k"] Jul 14 14:01:53.631289 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.631234 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" containerName="manager" Jul 14 14:01:53.631289 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.631254 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" containerName="manager" Jul 14 14:01:53.631432 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.631307 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" containerName="manager" Jul 14 14:01:53.631432 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.631316 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" containerName="manager" Jul 14 14:01:53.631432 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.631412 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" containerName="manager" Jul 14 14:01:53.631432 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.631424 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" containerName="manager" Jul 14 14:01:53.633212 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.633170 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.637199 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.637152 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.639637 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.639605 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.640717 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.640698 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6"] Jul 14 14:01:53.642882 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.642865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.644097 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.644073 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl"] Jul 14 14:01:53.644311 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.644287 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" containerName="manager" containerID="cri-o://8a9d6a306d9b1d79300888b07651125ccb28ed08dab7d3cad61521e9d2110b4c" gracePeriod=2 Jul 14 14:01:53.654131 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.654070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqkz\" (UniqueName: \"kubernetes.io/projected/161ce19f-9d45-452b-886b-1d78285e24e9-kube-api-access-wwqkz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zq4k\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.654262 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.654175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/161ce19f-9d45-452b-886b-1d78285e24e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zq4k\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.655390 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.655366 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k"] Jul 14 14:01:53.665942 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.665551 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl"] Jul 14 14:01:53.667512 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.667448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6"] Jul 14 14:01:53.676262 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.676212 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.679762 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.679737 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7"] Jul 14 14:01:53.680120 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.680105 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" containerName="manager" Jul 14 14:01:53.680218 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.680124 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" containerName="manager" Jul 14 14:01:53.680218 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.680216 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" containerName="manager" Jul 14 14:01:53.681957 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.681936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:01:53.695147 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.694236 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7"] Jul 14 14:01:53.702786 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.702756 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.719505 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.719478 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.721579 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.721557 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.754823 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.754799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a46fef34-569b-45a8-848b-12f2a8cbf686-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvvc6\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.754917 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.754837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/161ce19f-9d45-452b-886b-1d78285e24e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zq4k\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.754917 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.754904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhd7g\" (UniqueName: \"kubernetes.io/projected/ba5567f7-9818-4c93-b260-318566027658-kube-api-access-mhd7g\") pod \"limitador-operator-controller-manager-859d7b78bd-n87h7\" (UID: \"ba5567f7-9818-4c93-b260-318566027658\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:01:53.755005 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.754954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqt6r\" (UniqueName: \"kubernetes.io/projected/a46fef34-569b-45a8-848b-12f2a8cbf686-kube-api-access-mqt6r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvvc6\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.755054 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.755019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqkz\" (UniqueName: \"kubernetes.io/projected/161ce19f-9d45-452b-886b-1d78285e24e9-kube-api-access-wwqkz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zq4k\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.755210 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.755172 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/161ce19f-9d45-452b-886b-1d78285e24e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zq4k\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.764206 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.764159 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqkz\" (UniqueName: \"kubernetes.io/projected/161ce19f-9d45-452b-886b-1d78285e24e9-kube-api-access-wwqkz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zq4k\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:53.793497 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.793463 2574 generic.go:356] "Generic (PLEG): container finished" podID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" containerID="8a9d6a306d9b1d79300888b07651125ccb28ed08dab7d3cad61521e9d2110b4c" exitCode=0 Jul 14 14:01:53.796036 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.796009 2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" container="manager" Jul 14 14:01:53.797360 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.797324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544dd75647-46zln" event={"ID":"ba7e9265-66f7-4e18-abb9-a8f72c77d298","Type":"ContainerStarted","Data":"42f2c414c13255b1595c4fe44ec8d0ff49efea9bcdfbf3a6922f6d851845fa6c"} Jul 14 14:01:53.797469 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.797387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544dd75647-46zln" event={"ID":"ba7e9265-66f7-4e18-abb9-a8f72c77d298","Type":"ContainerStarted","Data":"079d3ab47ebabcd77a4b94e36945bd0c6f83471c574c563eb3ba80edfd21bc57"} Jul 14 14:01:53.797973 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.797935 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.799601 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.799579 2574 generic.go:356] "Generic (PLEG): container finished" podID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" containerID="9620203103d205e2b066e127d62451e4db729a0fea4bc7972f4333e2342773b5" exitCode=0 Jul 14 14:01:53.799988 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.799940 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.802909 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.802876 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.804749 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.804723 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.806872 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.806844 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.808648 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.808600 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.826821 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.826491 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544dd75647-46zln" podStartSLOduration=1.826472092 podStartE2EDuration="1.826472092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:53.826096459 +0000 UTC m=+481.894195373" watchObservedRunningTime="2026-07-14 14:01:53.826472092 +0000 UTC m=+481.894570948" Jul 14 14:01:53.855695 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.855622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a46fef34-569b-45a8-848b-12f2a8cbf686-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvvc6\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.856006 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.855982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhd7g\" (UniqueName: \"kubernetes.io/projected/ba5567f7-9818-4c93-b260-318566027658-kube-api-access-mhd7g\") pod \"limitador-operator-controller-manager-859d7b78bd-n87h7\" (UID: \"ba5567f7-9818-4c93-b260-318566027658\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:01:53.856116 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.856073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqt6r\" (UniqueName: \"kubernetes.io/projected/a46fef34-569b-45a8-848b-12f2a8cbf686-kube-api-access-mqt6r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvvc6\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.856207 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.856162 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a46fef34-569b-45a8-848b-12f2a8cbf686-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvvc6\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.888353 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.888122 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhd7g\" (UniqueName: \"kubernetes.io/projected/ba5567f7-9818-4c93-b260-318566027658-kube-api-access-mhd7g\") pod \"limitador-operator-controller-manager-859d7b78bd-n87h7\" (UID: \"ba5567f7-9818-4c93-b260-318566027658\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:01:53.888353 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.888176 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqt6r\" (UniqueName: \"kubernetes.io/projected/a46fef34-569b-45a8-848b-12f2a8cbf686-kube-api-access-mqt6r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvvc6\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:53.898272 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.898245 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.900648 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.900623 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.900772 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.900758 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.902481 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.902462 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.904105 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.904085 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.905792 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.905759 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vdpfl\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:53.907506 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.907482 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r9cwp\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:53.909226 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:53.909203 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:53.957068 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.957035 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-extensions-socket-volume\") pod \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " Jul 14 14:01:53.957242 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.957082 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgdn7\" (UniqueName: \"kubernetes.io/projected/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-kube-api-access-sgdn7\") pod \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\" (UID: \"9eeb9d16-f063-4cdc-ad3a-cab919ba7173\") " Jul 14 14:01:53.957242 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.957142 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq276\" (UniqueName: \"kubernetes.io/projected/ab9e2093-7b97-49da-a3c7-e20b6b50dd76-kube-api-access-cq276\") pod \"ab9e2093-7b97-49da-a3c7-e20b6b50dd76\" (UID: \"ab9e2093-7b97-49da-a3c7-e20b6b50dd76\") " Jul 14 14:01:53.957479 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.957458 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9eeb9d16-f063-4cdc-ad3a-cab919ba7173" (UID: "9eeb9d16-f063-4cdc-ad3a-cab919ba7173"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:01:53.959175 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.959151 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-kube-api-access-sgdn7" (OuterVolumeSpecName: "kube-api-access-sgdn7") pod "9eeb9d16-f063-4cdc-ad3a-cab919ba7173" (UID: "9eeb9d16-f063-4cdc-ad3a-cab919ba7173"). InnerVolumeSpecName "kube-api-access-sgdn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:01:53.959291 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:53.959172 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab9e2093-7b97-49da-a3c7-e20b6b50dd76-kube-api-access-cq276" (OuterVolumeSpecName: "kube-api-access-cq276") pod "ab9e2093-7b97-49da-a3c7-e20b6b50dd76" (UID: "ab9e2093-7b97-49da-a3c7-e20b6b50dd76"). InnerVolumeSpecName "kube-api-access-cq276". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:01:54.045470 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.045442 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:54.055360 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.055338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:54.058154 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.058132 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq276\" (UniqueName: \"kubernetes.io/projected/ab9e2093-7b97-49da-a3c7-e20b6b50dd76-kube-api-access-cq276\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:01:54.058270 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.058156 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-extensions-socket-volume\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:01:54.058270 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.058167 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgdn7\" (UniqueName: \"kubernetes.io/projected/9eeb9d16-f063-4cdc-ad3a-cab919ba7173-kube-api-access-sgdn7\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:01:54.063599 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.063578 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:01:54.204505 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.204459 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k"] Jul 14 14:01:54.207429 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:54.207396 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161ce19f_9d45_452b_886b_1d78285e24e9.slice/crio-ed6293a7fdd5c8d2f819241af8ba34132b1f4c0c1bef7006885cfd0a97eed8d8 WatchSource:0}: Error finding container ed6293a7fdd5c8d2f819241af8ba34132b1f4c0c1bef7006885cfd0a97eed8d8: Status 404 returned error can't find the container with id ed6293a7fdd5c8d2f819241af8ba34132b1f4c0c1bef7006885cfd0a97eed8d8 Jul 14 14:01:54.441647 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.441622 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7"] Jul 14 14:01:54.443480 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:54.443452 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5567f7_9818_4c93_b260_318566027658.slice/crio-707a467764a35e1f2d7a1d0551206b3d334642edd501a4f91126316abec48fa8 WatchSource:0}: Error finding container 707a467764a35e1f2d7a1d0551206b3d334642edd501a4f91126316abec48fa8: Status 404 returned error can't find the container with id 707a467764a35e1f2d7a1d0551206b3d334642edd501a4f91126316abec48fa8 Jul 14 14:01:54.443707 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.443685 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6"] Jul 14 14:01:54.444202 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:01:54.444159 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46fef34_569b_45a8_848b_12f2a8cbf686.slice/crio-a559d334755602b154805fba487cfd856ff2f03ffce6ac799e706677550af701 WatchSource:0}: Error finding container a559d334755602b154805fba487cfd856ff2f03ffce6ac799e706677550af701: Status 404 returned error can't find the container with id a559d334755602b154805fba487cfd856ff2f03ffce6ac799e706677550af701 Jul 14 14:01:54.488159 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.488134 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eeb9d16-f063-4cdc-ad3a-cab919ba7173" path="/var/lib/kubelet/pods/9eeb9d16-f063-4cdc-ad3a-cab919ba7173/volumes" Jul 14 14:01:54.488567 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.488549 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab9e2093-7b97-49da-a3c7-e20b6b50dd76" path="/var/lib/kubelet/pods/ab9e2093-7b97-49da-a3c7-e20b6b50dd76/volumes" Jul 14 14:01:54.811304 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.811211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" event={"ID":"a46fef34-569b-45a8-848b-12f2a8cbf686","Type":"ContainerStarted","Data":"f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971"} Jul 14 14:01:54.811704 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.811396 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:01:54.811704 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.811452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" event={"ID":"a46fef34-569b-45a8-848b-12f2a8cbf686","Type":"ContainerStarted","Data":"a559d334755602b154805fba487cfd856ff2f03ffce6ac799e706677550af701"} Jul 14 14:01:54.814986 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.814962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" event={"ID":"161ce19f-9d45-452b-886b-1d78285e24e9","Type":"ContainerStarted","Data":"b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28"} Jul 14 14:01:54.815107 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.815008 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" event={"ID":"161ce19f-9d45-452b-886b-1d78285e24e9","Type":"ContainerStarted","Data":"ed6293a7fdd5c8d2f819241af8ba34132b1f4c0c1bef7006885cfd0a97eed8d8"} Jul 14 14:01:54.815107 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.815076 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:01:54.816904 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.816887 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdpfl" Jul 14 14:01:54.817020 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.816894 2574 scope.go:117] "RemoveContainer" containerID="8a9d6a306d9b1d79300888b07651125ccb28ed08dab7d3cad61521e9d2110b4c" Jul 14 14:01:54.819146 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.819001 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" containerName="manager" containerID="cri-o://c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484" gracePeriod=2 Jul 14 14:01:54.821003 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.820984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" event={"ID":"ba5567f7-9818-4c93-b260-318566027658","Type":"ContainerStarted","Data":"aa91cbd6f70739bb96c1c6af68bca6f813447637aa83db7a9cd3eb410209e46b"} Jul 14 14:01:54.821097 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.821024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" event={"ID":"ba5567f7-9818-4c93-b260-318566027658","Type":"ContainerStarted","Data":"707a467764a35e1f2d7a1d0551206b3d334642edd501a4f91126316abec48fa8"} Jul 14 14:01:54.821097 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.821056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:01:54.822486 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.822466 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r9cwp" Jul 14 14:01:54.827469 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.827454 2574 scope.go:117] "RemoveContainer" containerID="9620203103d205e2b066e127d62451e4db729a0fea4bc7972f4333e2342773b5" Jul 14 14:01:54.836653 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.836618 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" podStartSLOduration=1.836607307 podStartE2EDuration="1.836607307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:54.835365808 +0000 UTC m=+482.903464662" watchObservedRunningTime="2026-07-14 14:01:54.836607307 +0000 UTC m=+482.904706143" Jul 14 14:01:54.871161 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.871116 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" podStartSLOduration=1.871101221 podStartE2EDuration="1.871101221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:54.869612194 +0000 UTC m=+482.937711061" watchObservedRunningTime="2026-07-14 14:01:54.871101221 +0000 UTC m=+482.939200076" Jul 14 14:01:54.901039 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:54.900995 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" podStartSLOduration=1.900986418 podStartE2EDuration="1.900986418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:01:54.899444642 +0000 UTC m=+482.967543518" watchObservedRunningTime="2026-07-14 14:01:54.900986418 +0000 UTC m=+482.969085273" Jul 14 14:01:55.070882 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.070822 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:55.074361 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:55.074333 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:55.168903 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.168873 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-extensions-socket-volume\") pod \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " Jul 14 14:01:55.169053 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.168944 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flf59\" (UniqueName: \"kubernetes.io/projected/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-kube-api-access-flf59\") pod \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\" (UID: \"05b8fd54-2c4f-41c6-b2bd-8cc68851fccd\") " Jul 14 14:01:55.169151 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.169130 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" (UID: "05b8fd54-2c4f-41c6-b2bd-8cc68851fccd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:01:55.170982 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.170954 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-kube-api-access-flf59" (OuterVolumeSpecName: "kube-api-access-flf59") pod "05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" (UID: "05b8fd54-2c4f-41c6-b2bd-8cc68851fccd"). InnerVolumeSpecName "kube-api-access-flf59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:01:55.270103 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.270071 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-extensions-socket-volume\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:01:55.270103 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.270103 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flf59\" (UniqueName: \"kubernetes.io/projected/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd-kube-api-access-flf59\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:01:55.829727 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.829690 2574 generic.go:356] "Generic (PLEG): container finished" podID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" containerID="c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484" exitCode=2 Jul 14 14:01:55.830162 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.829757 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:55.830162 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.829785 2574 scope.go:117] "RemoveContainer" containerID="c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484" Jul 14 14:01:55.832148 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:55.832124 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:55.839243 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.839226 2574 scope.go:117] "RemoveContainer" containerID="c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484" Jul 14 14:01:55.839493 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:55.839474 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484\": container with ID starting with c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484 not found: ID does not exist" containerID="c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484" Jul 14 14:01:55.839538 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:55.839502 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484"} err="failed to get container status \"c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484\": rpc error: code = NotFound desc = could not find container \"c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484\": container with ID starting with c0517e1b0269189928e19d35df326a772b08757c2cc1b904d77cca165cd8f484 not found: ID does not exist" Jul 14 14:01:55.840545 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:01:55.840524 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qn9w6\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qn9w6" Jul 14 14:01:56.487411 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:01:56.487376 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b8fd54-2c4f-41c6-b2bd-8cc68851fccd" path="/var/lib/kubelet/pods/05b8fd54-2c4f-41c6-b2bd-8cc68851fccd/volumes" Jul 14 14:02:02.654307 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:02.654270 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544dd75647-46zln" Jul 14 14:02:02.654799 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:02.654417 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544dd75647-46zln" Jul 14 14:02:02.659021 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:02.658999 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544dd75647-46zln" Jul 14 14:02:02.870773 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:02.870743 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544dd75647-46zln" Jul 14 14:02:05.833050 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:05.833023 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n87h7" Jul 14 14:02:05.833471 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:05.833091 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:02:05.833471 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:05.833248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:02:05.955124 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:05.955090 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6"] Jul 14 14:02:05.955404 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:05.955373 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" podUID="a46fef34-569b-45a8-848b-12f2a8cbf686" containerName="manager" containerID="cri-o://f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971" gracePeriod=10 Jul 14 14:02:06.180883 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.180853 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p"] Jul 14 14:02:06.183203 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.183171 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.206624 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.206602 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:02:06.229156 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.229135 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p"] Jul 14 14:02:06.269131 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.269104 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqt6r\" (UniqueName: \"kubernetes.io/projected/a46fef34-569b-45a8-848b-12f2a8cbf686-kube-api-access-mqt6r\") pod \"a46fef34-569b-45a8-848b-12f2a8cbf686\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " Jul 14 14:02:06.269283 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.269170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a46fef34-569b-45a8-848b-12f2a8cbf686-extensions-socket-volume\") pod \"a46fef34-569b-45a8-848b-12f2a8cbf686\" (UID: \"a46fef34-569b-45a8-848b-12f2a8cbf686\") " Jul 14 14:02:06.269451 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.269428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rjg2p\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.269498 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.269467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnkvm\" (UniqueName: \"kubernetes.io/projected/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-kube-api-access-xnkvm\") pod \"kuadrant-operator-controller-manager-86878c769f-rjg2p\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.269611 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.269582 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46fef34-569b-45a8-848b-12f2a8cbf686-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a46fef34-569b-45a8-848b-12f2a8cbf686" (UID: "a46fef34-569b-45a8-848b-12f2a8cbf686"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:02:06.271217 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.271175 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46fef34-569b-45a8-848b-12f2a8cbf686-kube-api-access-mqt6r" (OuterVolumeSpecName: "kube-api-access-mqt6r") pod "a46fef34-569b-45a8-848b-12f2a8cbf686" (UID: "a46fef34-569b-45a8-848b-12f2a8cbf686"). InnerVolumeSpecName "kube-api-access-mqt6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:02:06.370887 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.370852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rjg2p\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.370887 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.370889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnkvm\" (UniqueName: \"kubernetes.io/projected/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-kube-api-access-xnkvm\") pod \"kuadrant-operator-controller-manager-86878c769f-rjg2p\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.371072 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.370945 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqt6r\" (UniqueName: \"kubernetes.io/projected/a46fef34-569b-45a8-848b-12f2a8cbf686-kube-api-access-mqt6r\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:02:06.371072 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.370955 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a46fef34-569b-45a8-848b-12f2a8cbf686-extensions-socket-volume\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:02:06.371238 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.371212 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rjg2p\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.406362 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.406336 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnkvm\" (UniqueName: \"kubernetes.io/projected/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-kube-api-access-xnkvm\") pod \"kuadrant-operator-controller-manager-86878c769f-rjg2p\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.504605 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.504575 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.640634 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.640606 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p"] Jul 14 14:02:06.642938 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:02:06.642899 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236b51b6_7854_4fc1_aa66_1d2ff1d813b0.slice/crio-fb93e20e003b1e55aab6746fa8bf55d5c7fa77bb2aed4bc53f02548a1fbd86e8 WatchSource:0}: Error finding container fb93e20e003b1e55aab6746fa8bf55d5c7fa77bb2aed4bc53f02548a1fbd86e8: Status 404 returned error can't find the container with id fb93e20e003b1e55aab6746fa8bf55d5c7fa77bb2aed4bc53f02548a1fbd86e8 Jul 14 14:02:06.888268 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.888224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" event={"ID":"236b51b6-7854-4fc1-aa66-1d2ff1d813b0","Type":"ContainerStarted","Data":"8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b"} Jul 14 14:02:06.888673 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.888304 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:06.888673 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.888328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" event={"ID":"236b51b6-7854-4fc1-aa66-1d2ff1d813b0","Type":"ContainerStarted","Data":"fb93e20e003b1e55aab6746fa8bf55d5c7fa77bb2aed4bc53f02548a1fbd86e8"} Jul 14 14:02:06.889484 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.889460 2574 generic.go:356] "Generic (PLEG): container finished" podID="a46fef34-569b-45a8-848b-12f2a8cbf686" containerID="f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971" exitCode=0 Jul 14 14:02:06.889547 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.889495 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" Jul 14 14:02:06.889581 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.889539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" event={"ID":"a46fef34-569b-45a8-848b-12f2a8cbf686","Type":"ContainerDied","Data":"f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971"} Jul 14 14:02:06.889614 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.889583 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6" event={"ID":"a46fef34-569b-45a8-848b-12f2a8cbf686","Type":"ContainerDied","Data":"a559d334755602b154805fba487cfd856ff2f03ffce6ac799e706677550af701"} Jul 14 14:02:06.889614 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.889604 2574 scope.go:117] "RemoveContainer" containerID="f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971" Jul 14 14:02:06.898116 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.898101 2574 scope.go:117] "RemoveContainer" containerID="f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971" Jul 14 14:02:06.898370 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:02:06.898352 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971\": container with ID starting with f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971 not found: ID does not exist" containerID="f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971" Jul 14 14:02:06.898427 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.898378 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971"} err="failed to get container status \"f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971\": rpc error: code = NotFound desc = could not find container \"f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971\": container with ID starting with f3596f80e99d307822d3f38da2a0c6d71e44057a3bda2bee51d294ee82604971 not found: ID does not exist" Jul 14 14:02:06.919129 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.919057 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" podStartSLOduration=0.919044817 podStartE2EDuration="919.044817ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:02:06.916037051 +0000 UTC m=+494.984135906" watchObservedRunningTime="2026-07-14 14:02:06.919044817 +0000 UTC m=+494.987143670" Jul 14 14:02:06.941666 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.941640 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6"] Jul 14 14:02:06.947667 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:06.947647 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvvc6"] Jul 14 14:02:08.486993 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:08.486965 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46fef34-569b-45a8-848b-12f2a8cbf686" path="/var/lib/kubelet/pods/a46fef34-569b-45a8-848b-12f2a8cbf686/volumes" Jul 14 14:02:17.898689 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:17.898658 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:02:17.955341 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:17.955309 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k"] Jul 14 14:02:17.955531 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:17.955507 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" podUID="161ce19f-9d45-452b-886b-1d78285e24e9" containerName="manager" containerID="cri-o://b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28" gracePeriod=10 Jul 14 14:02:18.215431 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.215403 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:02:18.374092 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.374057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/161ce19f-9d45-452b-886b-1d78285e24e9-extensions-socket-volume\") pod \"161ce19f-9d45-452b-886b-1d78285e24e9\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " Jul 14 14:02:18.374304 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.374143 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwqkz\" (UniqueName: \"kubernetes.io/projected/161ce19f-9d45-452b-886b-1d78285e24e9-kube-api-access-wwqkz\") pod \"161ce19f-9d45-452b-886b-1d78285e24e9\" (UID: \"161ce19f-9d45-452b-886b-1d78285e24e9\") " Jul 14 14:02:18.374517 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.374495 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161ce19f-9d45-452b-886b-1d78285e24e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "161ce19f-9d45-452b-886b-1d78285e24e9" (UID: "161ce19f-9d45-452b-886b-1d78285e24e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:02:18.376208 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.376171 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161ce19f-9d45-452b-886b-1d78285e24e9-kube-api-access-wwqkz" (OuterVolumeSpecName: "kube-api-access-wwqkz") pod "161ce19f-9d45-452b-886b-1d78285e24e9" (UID: "161ce19f-9d45-452b-886b-1d78285e24e9"). InnerVolumeSpecName "kube-api-access-wwqkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:02:18.475659 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.475556 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/161ce19f-9d45-452b-886b-1d78285e24e9-extensions-socket-volume\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:02:18.475659 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.475600 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwqkz\" (UniqueName: \"kubernetes.io/projected/161ce19f-9d45-452b-886b-1d78285e24e9-kube-api-access-wwqkz\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:02:18.954611 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.954574 2574 generic.go:356] "Generic (PLEG): container finished" podID="161ce19f-9d45-452b-886b-1d78285e24e9" containerID="b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28" exitCode=0 Jul 14 14:02:18.954611 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.954615 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" event={"ID":"161ce19f-9d45-452b-886b-1d78285e24e9","Type":"ContainerDied","Data":"b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28"} Jul 14 14:02:18.955132 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.954623 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" Jul 14 14:02:18.955132 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.954656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k" event={"ID":"161ce19f-9d45-452b-886b-1d78285e24e9","Type":"ContainerDied","Data":"ed6293a7fdd5c8d2f819241af8ba34132b1f4c0c1bef7006885cfd0a97eed8d8"} Jul 14 14:02:18.955132 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.954676 2574 scope.go:117] "RemoveContainer" containerID="b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28" Jul 14 14:02:18.963660 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.963473 2574 scope.go:117] "RemoveContainer" containerID="b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28" Jul 14 14:02:18.963762 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:02:18.963742 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28\": container with ID starting with b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28 not found: ID does not exist" containerID="b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28" Jul 14 14:02:18.963803 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.963771 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28"} err="failed to get container status \"b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28\": rpc error: code = NotFound desc = could not find container \"b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28\": container with ID starting with b2cda391451209e58288876eddd2ee3be4022b58e2ea14aa93fb88c07911ce28 not found: ID does not exist" Jul 14 14:02:18.984032 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.984008 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k"] Jul 14 14:02:18.996855 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:18.996831 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zq4k"] Jul 14 14:02:20.487331 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:20.487300 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161ce19f-9d45-452b-886b-1d78285e24e9" path="/var/lib/kubelet/pods/161ce19f-9d45-452b-886b-1d78285e24e9/volumes" Jul 14 14:02:33.614436 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614400 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:33.614912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614757 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46fef34-569b-45a8-848b-12f2a8cbf686" containerName="manager" Jul 14 14:02:33.614912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614768 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46fef34-569b-45a8-848b-12f2a8cbf686" containerName="manager" Jul 14 14:02:33.614912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614789 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161ce19f-9d45-452b-886b-1d78285e24e9" containerName="manager" Jul 14 14:02:33.614912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614794 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="161ce19f-9d45-452b-886b-1d78285e24e9" containerName="manager" Jul 14 14:02:33.614912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614854 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="161ce19f-9d45-452b-886b-1d78285e24e9" containerName="manager" Jul 14 14:02:33.614912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.614863 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46fef34-569b-45a8-848b-12f2a8cbf686" containerName="manager" Jul 14 14:02:33.619548 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.619527 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.621932 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.621914 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 14:02:33.622142 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.622128 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ncn5b\"" Jul 14 14:02:33.629499 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.629473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:33.716873 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.716835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:33.801593 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.801556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21659b14-30a4-42f8-8ad0-e343dc3fcf12-config-file\") pod \"limitador-limitador-64c94fd64f-rn6vz\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.801763 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.801697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj46l\" (UniqueName: \"kubernetes.io/projected/21659b14-30a4-42f8-8ad0-e343dc3fcf12-kube-api-access-kj46l\") pod \"limitador-limitador-64c94fd64f-rn6vz\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.902516 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.902420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj46l\" (UniqueName: \"kubernetes.io/projected/21659b14-30a4-42f8-8ad0-e343dc3fcf12-kube-api-access-kj46l\") pod \"limitador-limitador-64c94fd64f-rn6vz\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.902688 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.902520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21659b14-30a4-42f8-8ad0-e343dc3fcf12-config-file\") pod \"limitador-limitador-64c94fd64f-rn6vz\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.903156 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.903131 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21659b14-30a4-42f8-8ad0-e343dc3fcf12-config-file\") pod \"limitador-limitador-64c94fd64f-rn6vz\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.911886 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.911863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj46l\" (UniqueName: \"kubernetes.io/projected/21659b14-30a4-42f8-8ad0-e343dc3fcf12-kube-api-access-kj46l\") pod \"limitador-limitador-64c94fd64f-rn6vz\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:33.930722 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:33.930695 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:34.072490 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:34.072465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:34.074893 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:02:34.074864 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21659b14_30a4_42f8_8ad0_e343dc3fcf12.slice/crio-8f031d3c02c11d51acff527a4a0bdb2c90fe251406f8298a78c9c2aac0a90dbc WatchSource:0}: Error finding container 8f031d3c02c11d51acff527a4a0bdb2c90fe251406f8298a78c9c2aac0a90dbc: Status 404 returned error can't find the container with id 8f031d3c02c11d51acff527a4a0bdb2c90fe251406f8298a78c9c2aac0a90dbc Jul 14 14:02:34.936986 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:34.936949 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qdgk2"] Jul 14 14:02:34.940414 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:34.940386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:02:34.943416 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:34.943398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-79trx\"" Jul 14 14:02:34.953601 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:34.953576 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qdgk2"] Jul 14 14:02:35.010078 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:35.010038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvhs\" (UniqueName: \"kubernetes.io/projected/e24354f3-b910-4ced-8fc7-546025b1c934-kube-api-access-zqvhs\") pod \"authorino-75d556bd77-qdgk2\" (UID: \"e24354f3-b910-4ced-8fc7-546025b1c934\") " pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:02:35.040520 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:35.040445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" event={"ID":"21659b14-30a4-42f8-8ad0-e343dc3fcf12","Type":"ContainerStarted","Data":"8f031d3c02c11d51acff527a4a0bdb2c90fe251406f8298a78c9c2aac0a90dbc"} Jul 14 14:02:35.110744 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:35.110687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvhs\" (UniqueName: \"kubernetes.io/projected/e24354f3-b910-4ced-8fc7-546025b1c934-kube-api-access-zqvhs\") pod \"authorino-75d556bd77-qdgk2\" (UID: \"e24354f3-b910-4ced-8fc7-546025b1c934\") " pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:02:35.130104 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:35.130066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvhs\" (UniqueName: \"kubernetes.io/projected/e24354f3-b910-4ced-8fc7-546025b1c934-kube-api-access-zqvhs\") pod \"authorino-75d556bd77-qdgk2\" (UID: \"e24354f3-b910-4ced-8fc7-546025b1c934\") " pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:02:35.250801 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:35.250706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:02:35.433858 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:35.433786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qdgk2"] Jul 14 14:02:35.437898 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:02:35.437864 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode24354f3_b910_4ced_8fc7_546025b1c934.slice/crio-b0cbfbf5c0fa6992e8f0ee81413fecc96c3afe43094e551bbb789bd4045c319b WatchSource:0}: Error finding container b0cbfbf5c0fa6992e8f0ee81413fecc96c3afe43094e551bbb789bd4045c319b: Status 404 returned error can't find the container with id b0cbfbf5c0fa6992e8f0ee81413fecc96c3afe43094e551bbb789bd4045c319b Jul 14 14:02:36.049901 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:36.049861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qdgk2" event={"ID":"e24354f3-b910-4ced-8fc7-546025b1c934","Type":"ContainerStarted","Data":"b0cbfbf5c0fa6992e8f0ee81413fecc96c3afe43094e551bbb789bd4045c319b"} Jul 14 14:02:40.074422 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:40.074382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" event={"ID":"21659b14-30a4-42f8-8ad0-e343dc3fcf12","Type":"ContainerStarted","Data":"b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23"} Jul 14 14:02:40.074853 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:40.074547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:40.075851 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:40.075829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qdgk2" event={"ID":"e24354f3-b910-4ced-8fc7-546025b1c934","Type":"ContainerStarted","Data":"4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915"} Jul 14 14:02:40.131808 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:40.131761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" podStartSLOduration=2.21030313 podStartE2EDuration="7.131747938s" totalImagesPullingTime="4.921444808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:02:40.129810494 +0000 UTC m=+528.197909349" watchObservedRunningTime="2026-07-14 14:02:40.131747938 +0000 UTC m=+528.199846793" Jul 14 14:02:40.157147 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:40.157099 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qdgk2" podStartSLOduration=2.542770891 podStartE2EDuration="6.157087045s" totalImagesPullingTime="3.614316154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:02:40.156211143 +0000 UTC m=+528.224309995" watchObservedRunningTime="2026-07-14 14:02:40.157087045 +0000 UTC m=+528.225185901" Jul 14 14:02:51.083019 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:51.082989 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:51.802053 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:51.802022 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:51.802305 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:51.802276 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" podUID="21659b14-30a4-42f8-8ad0-e343dc3fcf12" containerName="limitador" containerID="cri-o://b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23" gracePeriod=30 Jul 14 14:02:52.352632 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.352602 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:52.451115 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.451092 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj46l\" (UniqueName: \"kubernetes.io/projected/21659b14-30a4-42f8-8ad0-e343dc3fcf12-kube-api-access-kj46l\") pod \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " Jul 14 14:02:52.451242 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.451157 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21659b14-30a4-42f8-8ad0-e343dc3fcf12-config-file\") pod \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\" (UID: \"21659b14-30a4-42f8-8ad0-e343dc3fcf12\") " Jul 14 14:02:52.451463 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.451439 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21659b14-30a4-42f8-8ad0-e343dc3fcf12-config-file" (OuterVolumeSpecName: "config-file") pod "21659b14-30a4-42f8-8ad0-e343dc3fcf12" (UID: "21659b14-30a4-42f8-8ad0-e343dc3fcf12"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:02:52.453116 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.453091 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21659b14-30a4-42f8-8ad0-e343dc3fcf12-kube-api-access-kj46l" (OuterVolumeSpecName: "kube-api-access-kj46l") pod "21659b14-30a4-42f8-8ad0-e343dc3fcf12" (UID: "21659b14-30a4-42f8-8ad0-e343dc3fcf12"). InnerVolumeSpecName "kube-api-access-kj46l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:02:52.552370 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.552339 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj46l\" (UniqueName: \"kubernetes.io/projected/21659b14-30a4-42f8-8ad0-e343dc3fcf12-kube-api-access-kj46l\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:02:52.552370 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:52.552367 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21659b14-30a4-42f8-8ad0-e343dc3fcf12-config-file\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:02:53.140156 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.140123 2574 generic.go:356] "Generic (PLEG): container finished" podID="21659b14-30a4-42f8-8ad0-e343dc3fcf12" containerID="b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23" exitCode=0 Jul 14 14:02:53.140352 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.140176 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" Jul 14 14:02:53.140352 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.140205 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" event={"ID":"21659b14-30a4-42f8-8ad0-e343dc3fcf12","Type":"ContainerDied","Data":"b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23"} Jul 14 14:02:53.140352 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.140256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rn6vz" event={"ID":"21659b14-30a4-42f8-8ad0-e343dc3fcf12","Type":"ContainerDied","Data":"8f031d3c02c11d51acff527a4a0bdb2c90fe251406f8298a78c9c2aac0a90dbc"} Jul 14 14:02:53.140352 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.140280 2574 scope.go:117] "RemoveContainer" containerID="b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23" Jul 14 14:02:53.148889 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.148873 2574 scope.go:117] "RemoveContainer" containerID="b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23" Jul 14 14:02:53.149134 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:02:53.149109 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23\": container with ID starting with b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23 not found: ID does not exist" containerID="b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23" Jul 14 14:02:53.149241 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.149141 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23"} err="failed to get container status \"b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23\": rpc error: code = NotFound desc = could not find container \"b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23\": container with ID starting with b100f721f0ba4a3ed2ffc8649285606513bd5600cee09f4a09c5d8a855622b23 not found: ID does not exist" Jul 14 14:02:53.170790 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.170768 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:53.175375 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:53.175355 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rn6vz"] Jul 14 14:02:54.486750 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:54.486702 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21659b14-30a4-42f8-8ad0-e343dc3fcf12" path="/var/lib/kubelet/pods/21659b14-30a4-42f8-8ad0-e343dc3fcf12/volumes" Jul 14 14:02:57.122030 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.121943 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd"] Jul 14 14:02:57.122539 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.122522 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21659b14-30a4-42f8-8ad0-e343dc3fcf12" containerName="limitador" Jul 14 14:02:57.122582 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.122543 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="21659b14-30a4-42f8-8ad0-e343dc3fcf12" containerName="limitador" Jul 14 14:02:57.122652 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.122641 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="21659b14-30a4-42f8-8ad0-e343dc3fcf12" containerName="limitador" Jul 14 14:02:57.127731 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.127712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.130440 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.130413 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 14:02:57.130440 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.130431 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 14:02:57.130594 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.130510 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 14:02:57.131029 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.131015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-z6pf8\"" Jul 14 14:02:57.135275 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.135253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd"] Jul 14 14:02:57.190467 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.190439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgjnz\" (UniqueName: \"kubernetes.io/projected/91069b9f-98e3-4378-b4d2-d5d407670367-kube-api-access-tgjnz\") pod \"postgres-69fb4594cf-zsqpd\" (UID: \"91069b9f-98e3-4378-b4d2-d5d407670367\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.190622 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.190489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/91069b9f-98e3-4378-b4d2-d5d407670367-data\") pod \"postgres-69fb4594cf-zsqpd\" (UID: \"91069b9f-98e3-4378-b4d2-d5d407670367\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.291468 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.291439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgjnz\" (UniqueName: \"kubernetes.io/projected/91069b9f-98e3-4378-b4d2-d5d407670367-kube-api-access-tgjnz\") pod \"postgres-69fb4594cf-zsqpd\" (UID: \"91069b9f-98e3-4378-b4d2-d5d407670367\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.291634 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.291495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/91069b9f-98e3-4378-b4d2-d5d407670367-data\") pod \"postgres-69fb4594cf-zsqpd\" (UID: \"91069b9f-98e3-4378-b4d2-d5d407670367\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.291836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.291817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/91069b9f-98e3-4378-b4d2-d5d407670367-data\") pod \"postgres-69fb4594cf-zsqpd\" (UID: \"91069b9f-98e3-4378-b4d2-d5d407670367\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.300342 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.300308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgjnz\" (UniqueName: \"kubernetes.io/projected/91069b9f-98e3-4378-b4d2-d5d407670367-kube-api-access-tgjnz\") pod \"postgres-69fb4594cf-zsqpd\" (UID: \"91069b9f-98e3-4378-b4d2-d5d407670367\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.438827 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.438794 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:02:57.574670 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:57.574607 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd"] Jul 14 14:02:57.577138 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:02:57.577113 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91069b9f_98e3_4378_b4d2_d5d407670367.slice/crio-c7c2c1c15bb26118b832dbc93ceb6071bb3868d44eebbc4cd05e3c8525852f3b WatchSource:0}: Error finding container c7c2c1c15bb26118b832dbc93ceb6071bb3868d44eebbc4cd05e3c8525852f3b: Status 404 returned error can't find the container with id c7c2c1c15bb26118b832dbc93ceb6071bb3868d44eebbc4cd05e3c8525852f3b Jul 14 14:02:58.173834 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:02:58.173798 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" event={"ID":"91069b9f-98e3-4378-b4d2-d5d407670367","Type":"ContainerStarted","Data":"c7c2c1c15bb26118b832dbc93ceb6071bb3868d44eebbc4cd05e3c8525852f3b"} Jul 14 14:03:03.203755 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:03.203711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" event={"ID":"91069b9f-98e3-4378-b4d2-d5d407670367","Type":"ContainerStarted","Data":"3dbd98e00db565719a5b0a2ca5ab046db675ecef9069b4c7087c5ab5252ab9c6"} Jul 14 14:03:03.204138 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:03.203855 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:03:03.221514 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:03.221464 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" podStartSLOduration=1.36616389 podStartE2EDuration="6.22145094s" totalImagesPullingTime="4.85528705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:03:03.21942528 +0000 UTC m=+551.287524134" watchObservedRunningTime="2026-07-14 14:03:03.22145094 +0000 UTC m=+551.289549795" Jul 14 14:03:09.237884 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:09.237846 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsqpd" Jul 14 14:03:09.849439 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:09.849406 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5wjv"] Jul 14 14:03:09.855639 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:09.855607 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:09.861971 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:09.861938 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5wjv"] Jul 14 14:03:09.904608 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:09.904568 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzh7\" (UniqueName: \"kubernetes.io/projected/32ff2533-77cf-42a9-a2c5-b372ee60e728-kube-api-access-6qzh7\") pod \"authorino-5d4b67c446-p5wjv\" (UID: \"32ff2533-77cf-42a9-a2c5-b372ee60e728\") " pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:10.005936 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:10.005892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzh7\" (UniqueName: \"kubernetes.io/projected/32ff2533-77cf-42a9-a2c5-b372ee60e728-kube-api-access-6qzh7\") pod \"authorino-5d4b67c446-p5wjv\" (UID: \"32ff2533-77cf-42a9-a2c5-b372ee60e728\") " pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:10.014723 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:10.014691 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzh7\" (UniqueName: \"kubernetes.io/projected/32ff2533-77cf-42a9-a2c5-b372ee60e728-kube-api-access-6qzh7\") pod \"authorino-5d4b67c446-p5wjv\" (UID: \"32ff2533-77cf-42a9-a2c5-b372ee60e728\") " pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:10.083999 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:10.083958 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5wjv"] Jul 14 14:03:10.084249 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:10.084236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:10.220641 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:10.220610 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5wjv"] Jul 14 14:03:10.222792 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:03:10.222760 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32ff2533_77cf_42a9_a2c5_b372ee60e728.slice/crio-090fc5723fdabb8301699e57054e05ba4b6623d3f7682255f36275a5f21e2e6b WatchSource:0}: Error finding container 090fc5723fdabb8301699e57054e05ba4b6623d3f7682255f36275a5f21e2e6b: Status 404 returned error can't find the container with id 090fc5723fdabb8301699e57054e05ba4b6623d3f7682255f36275a5f21e2e6b Jul 14 14:03:10.239600 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:10.239569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" event={"ID":"32ff2533-77cf-42a9-a2c5-b372ee60e728","Type":"ContainerStarted","Data":"090fc5723fdabb8301699e57054e05ba4b6623d3f7682255f36275a5f21e2e6b"} Jul 14 14:03:11.246826 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.246787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" event={"ID":"32ff2533-77cf-42a9-a2c5-b372ee60e728","Type":"ContainerStarted","Data":"01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803"} Jul 14 14:03:11.247276 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.246895 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" podUID="32ff2533-77cf-42a9-a2c5-b372ee60e728" containerName="authorino" containerID="cri-o://01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803" gracePeriod=30 Jul 14 14:03:11.264026 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.263976 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" podStartSLOduration=1.862631757 podStartE2EDuration="2.263959904s" totalImagesPullingTime="401.328147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:03:11.262084967 +0000 UTC m=+559.330183824" watchObservedRunningTime="2026-07-14 14:03:11.263959904 +0000 UTC m=+559.332058759" Jul 14 14:03:11.571381 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.571351 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:11.720204 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.720148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qzh7\" (UniqueName: \"kubernetes.io/projected/32ff2533-77cf-42a9-a2c5-b372ee60e728-kube-api-access-6qzh7\") pod \"32ff2533-77cf-42a9-a2c5-b372ee60e728\" (UID: \"32ff2533-77cf-42a9-a2c5-b372ee60e728\") " Jul 14 14:03:11.722126 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.722107 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ff2533-77cf-42a9-a2c5-b372ee60e728-kube-api-access-6qzh7" (OuterVolumeSpecName: "kube-api-access-6qzh7") pod "32ff2533-77cf-42a9-a2c5-b372ee60e728" (UID: "32ff2533-77cf-42a9-a2c5-b372ee60e728"). InnerVolumeSpecName "kube-api-access-6qzh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:03:11.821736 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.821675 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qzh7\" (UniqueName: \"kubernetes.io/projected/32ff2533-77cf-42a9-a2c5-b372ee60e728-kube-api-access-6qzh7\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:03:11.927418 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.927379 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qdgk2"] Jul 14 14:03:11.927588 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:11.927561 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qdgk2" podUID="e24354f3-b910-4ced-8fc7-546025b1c934" containerName="authorino" containerID="cri-o://4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915" gracePeriod=30 Jul 14 14:03:12.240707 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.240673 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:03:12.253890 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.253855 2574 generic.go:356] "Generic (PLEG): container finished" podID="e24354f3-b910-4ced-8fc7-546025b1c934" containerID="4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915" exitCode=0 Jul 14 14:03:12.254285 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.253893 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qdgk2" Jul 14 14:03:12.254285 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.253944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qdgk2" event={"ID":"e24354f3-b910-4ced-8fc7-546025b1c934","Type":"ContainerDied","Data":"4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915"} Jul 14 14:03:12.254285 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.253984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qdgk2" event={"ID":"e24354f3-b910-4ced-8fc7-546025b1c934","Type":"ContainerDied","Data":"b0cbfbf5c0fa6992e8f0ee81413fecc96c3afe43094e551bbb789bd4045c319b"} Jul 14 14:03:12.254285 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.254004 2574 scope.go:117] "RemoveContainer" containerID="4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915" Jul 14 14:03:12.256318 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.256290 2574 generic.go:356] "Generic (PLEG): container finished" podID="32ff2533-77cf-42a9-a2c5-b372ee60e728" containerID="01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803" exitCode=0 Jul 14 14:03:12.256439 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.256321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" event={"ID":"32ff2533-77cf-42a9-a2c5-b372ee60e728","Type":"ContainerDied","Data":"01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803"} Jul 14 14:03:12.256439 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.256367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" event={"ID":"32ff2533-77cf-42a9-a2c5-b372ee60e728","Type":"ContainerDied","Data":"090fc5723fdabb8301699e57054e05ba4b6623d3f7682255f36275a5f21e2e6b"} Jul 14 14:03:12.256439 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.256327 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5wjv" Jul 14 14:03:12.264908 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.264878 2574 scope.go:117] "RemoveContainer" containerID="4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915" Jul 14 14:03:12.265228 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:03:12.265201 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915\": container with ID starting with 4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915 not found: ID does not exist" containerID="4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915" Jul 14 14:03:12.265330 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.265234 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915"} err="failed to get container status \"4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915\": rpc error: code = NotFound desc = could not find container \"4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915\": container with ID starting with 4ef6a075f77db7d78fba532b35455b424464ddc33aa890e7e5e3a1debc48b915 not found: ID does not exist" Jul 14 14:03:12.265330 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.265257 2574 scope.go:117] "RemoveContainer" containerID="01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803" Jul 14 14:03:12.278774 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.278751 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5wjv"] Jul 14 14:03:12.283009 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.282980 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5wjv"] Jul 14 14:03:12.283082 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.283040 2574 scope.go:117] "RemoveContainer" containerID="01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803" Jul 14 14:03:12.283385 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:03:12.283364 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803\": container with ID starting with 01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803 not found: ID does not exist" containerID="01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803" Jul 14 14:03:12.283472 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.283391 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803"} err="failed to get container status \"01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803\": rpc error: code = NotFound desc = could not find container \"01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803\": container with ID starting with 01d0b69164e4553035427f0b11b4b94bfa4a8372cc80851cb5ff4a508e50a803 not found: ID does not exist" Jul 14 14:03:12.325952 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.325927 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqvhs\" (UniqueName: \"kubernetes.io/projected/e24354f3-b910-4ced-8fc7-546025b1c934-kube-api-access-zqvhs\") pod \"e24354f3-b910-4ced-8fc7-546025b1c934\" (UID: \"e24354f3-b910-4ced-8fc7-546025b1c934\") " Jul 14 14:03:12.327818 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.327798 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24354f3-b910-4ced-8fc7-546025b1c934-kube-api-access-zqvhs" (OuterVolumeSpecName: "kube-api-access-zqvhs") pod "e24354f3-b910-4ced-8fc7-546025b1c934" (UID: "e24354f3-b910-4ced-8fc7-546025b1c934"). InnerVolumeSpecName "kube-api-access-zqvhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:03:12.426490 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.426464 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqvhs\" (UniqueName: \"kubernetes.io/projected/e24354f3-b910-4ced-8fc7-546025b1c934-kube-api-access-zqvhs\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:03:12.487577 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.487540 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ff2533-77cf-42a9-a2c5-b372ee60e728" path="/var/lib/kubelet/pods/32ff2533-77cf-42a9-a2c5-b372ee60e728/volumes" Jul 14 14:03:12.569654 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.569625 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qdgk2"] Jul 14 14:03:12.574158 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:12.574130 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qdgk2"] Jul 14 14:03:14.487292 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:14.487251 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e24354f3-b910-4ced-8fc7-546025b1c934" path="/var/lib/kubelet/pods/e24354f3-b910-4ced-8fc7-546025b1c934/volumes" Jul 14 14:03:16.967854 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.967816 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c87fd94db-jpd64"] Jul 14 14:03:16.968267 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.968196 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ff2533-77cf-42a9-a2c5-b372ee60e728" containerName="authorino" Jul 14 14:03:16.968267 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.968209 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ff2533-77cf-42a9-a2c5-b372ee60e728" containerName="authorino" Jul 14 14:03:16.968267 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.968217 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24354f3-b910-4ced-8fc7-546025b1c934" containerName="authorino" Jul 14 14:03:16.968267 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.968222 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24354f3-b910-4ced-8fc7-546025b1c934" containerName="authorino" Jul 14 14:03:16.968422 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.968323 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ff2533-77cf-42a9-a2c5-b372ee60e728" containerName="authorino" Jul 14 14:03:16.968422 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.968334 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24354f3-b910-4ced-8fc7-546025b1c934" containerName="authorino" Jul 14 14:03:16.971438 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.971420 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:16.974643 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.974618 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-42t4s\"" Jul 14 14:03:16.974785 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.974725 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 14:03:16.975445 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:16.975426 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 14:03:17.005435 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.005403 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c87fd94db-jpd64"] Jul 14 14:03:17.064740 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.064706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d778383c-ee92-4a47-a273-239a355ef87b-webhook-cert\") pod \"maas-controller-c87fd94db-jpd64\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.064921 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.064755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c84mq\" (UniqueName: \"kubernetes.io/projected/d778383c-ee92-4a47-a273-239a355ef87b-kube-api-access-c84mq\") pod \"maas-controller-c87fd94db-jpd64\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.165588 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.165542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d778383c-ee92-4a47-a273-239a355ef87b-webhook-cert\") pod \"maas-controller-c87fd94db-jpd64\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.165588 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.165590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c84mq\" (UniqueName: \"kubernetes.io/projected/d778383c-ee92-4a47-a273-239a355ef87b-kube-api-access-c84mq\") pod \"maas-controller-c87fd94db-jpd64\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.168080 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.168055 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d778383c-ee92-4a47-a273-239a355ef87b-webhook-cert\") pod \"maas-controller-c87fd94db-jpd64\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.181503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.181468 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c84mq\" (UniqueName: \"kubernetes.io/projected/d778383c-ee92-4a47-a273-239a355ef87b-kube-api-access-c84mq\") pod \"maas-controller-c87fd94db-jpd64\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.278524 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.278423 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bdf659b57-2swxw"] Jul 14 14:03:17.282214 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.282175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.282367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.282214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:17.304123 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.304097 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-2swxw"] Jul 14 14:03:17.367977 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.367943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dwk\" (UniqueName: \"kubernetes.io/projected/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-kube-api-access-r8dwk\") pod \"maas-controller-6bdf659b57-2swxw\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.368125 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.367991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-webhook-cert\") pod \"maas-controller-6bdf659b57-2swxw\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.423112 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.423079 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c87fd94db-jpd64"] Jul 14 14:03:17.426293 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:03:17.426265 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd778383c_ee92_4a47_a273_239a355ef87b.slice/crio-38208a41c8cfe906ff60d3b83d14877a693a85199e10a133ff43657018ffa816 WatchSource:0}: Error finding container 38208a41c8cfe906ff60d3b83d14877a693a85199e10a133ff43657018ffa816: Status 404 returned error can't find the container with id 38208a41c8cfe906ff60d3b83d14877a693a85199e10a133ff43657018ffa816 Jul 14 14:03:17.468926 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.468896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dwk\" (UniqueName: \"kubernetes.io/projected/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-kube-api-access-r8dwk\") pod \"maas-controller-6bdf659b57-2swxw\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.469076 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.468934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-webhook-cert\") pod \"maas-controller-6bdf659b57-2swxw\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.471364 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.471343 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-webhook-cert\") pod \"maas-controller-6bdf659b57-2swxw\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.477737 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.477718 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dwk\" (UniqueName: \"kubernetes.io/projected/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-kube-api-access-r8dwk\") pod \"maas-controller-6bdf659b57-2swxw\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.612157 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.612075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:17.746993 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:17.746966 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-2swxw"] Jul 14 14:03:17.749053 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:03:17.749025 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae41535_e3c1_4af2_8f1c_56c425b7a68a.slice/crio-4f973b6fd36826463f9ebda14c72f160483fd1548884fe162919584658ca1c70 WatchSource:0}: Error finding container 4f973b6fd36826463f9ebda14c72f160483fd1548884fe162919584658ca1c70: Status 404 returned error can't find the container with id 4f973b6fd36826463f9ebda14c72f160483fd1548884fe162919584658ca1c70 Jul 14 14:03:18.289163 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:18.289120 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bdf659b57-2swxw" event={"ID":"4ae41535-e3c1-4af2-8f1c-56c425b7a68a","Type":"ContainerStarted","Data":"4f973b6fd36826463f9ebda14c72f160483fd1548884fe162919584658ca1c70"} Jul 14 14:03:18.290380 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:18.290353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87fd94db-jpd64" event={"ID":"d778383c-ee92-4a47-a273-239a355ef87b","Type":"ContainerStarted","Data":"38208a41c8cfe906ff60d3b83d14877a693a85199e10a133ff43657018ffa816"} Jul 14 14:03:21.309539 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:21.309502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87fd94db-jpd64" event={"ID":"d778383c-ee92-4a47-a273-239a355ef87b","Type":"ContainerStarted","Data":"71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b"} Jul 14 14:03:21.309979 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:21.309584 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:21.311135 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:21.311111 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bdf659b57-2swxw" event={"ID":"4ae41535-e3c1-4af2-8f1c-56c425b7a68a","Type":"ContainerStarted","Data":"26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3"} Jul 14 14:03:21.311255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:21.311232 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:21.329360 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:21.329311 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c87fd94db-jpd64" podStartSLOduration=2.129464593 podStartE2EDuration="5.329297056s" totalImagesPullingTime="3.199832463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:03:21.327012541 +0000 UTC m=+569.395111397" watchObservedRunningTime="2026-07-14 14:03:21.329297056 +0000 UTC m=+569.397395936" Jul 14 14:03:21.349478 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:21.349436 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bdf659b57-2swxw" podStartSLOduration=1.482117619 podStartE2EDuration="4.349423709s" totalImagesPullingTime="2.86730609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:03:21.348203122 +0000 UTC m=+569.416301986" watchObservedRunningTime="2026-07-14 14:03:21.349423709 +0000 UTC m=+569.417522564" Jul 14 14:03:32.318436 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.318402 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:32.318831 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.318476 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:03:32.426350 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.426322 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c87fd94db-jpd64"] Jul 14 14:03:32.426540 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.426514 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c87fd94db-jpd64" podUID="d778383c-ee92-4a47-a273-239a355ef87b" containerName="manager" containerID="cri-o://71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b" gracePeriod=30 Jul 14 14:03:32.678508 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.678483 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:32.804340 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.804297 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d778383c-ee92-4a47-a273-239a355ef87b-webhook-cert\") pod \"d778383c-ee92-4a47-a273-239a355ef87b\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " Jul 14 14:03:32.804528 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.804348 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c84mq\" (UniqueName: \"kubernetes.io/projected/d778383c-ee92-4a47-a273-239a355ef87b-kube-api-access-c84mq\") pod \"d778383c-ee92-4a47-a273-239a355ef87b\" (UID: \"d778383c-ee92-4a47-a273-239a355ef87b\") " Jul 14 14:03:32.806457 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.806419 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d778383c-ee92-4a47-a273-239a355ef87b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d778383c-ee92-4a47-a273-239a355ef87b" (UID: "d778383c-ee92-4a47-a273-239a355ef87b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:03:32.806565 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.806461 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d778383c-ee92-4a47-a273-239a355ef87b-kube-api-access-c84mq" (OuterVolumeSpecName: "kube-api-access-c84mq") pod "d778383c-ee92-4a47-a273-239a355ef87b" (UID: "d778383c-ee92-4a47-a273-239a355ef87b"). InnerVolumeSpecName "kube-api-access-c84mq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:03:32.905505 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.905481 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d778383c-ee92-4a47-a273-239a355ef87b-webhook-cert\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:03:32.905613 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:32.905506 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c84mq\" (UniqueName: \"kubernetes.io/projected/d778383c-ee92-4a47-a273-239a355ef87b-kube-api-access-c84mq\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:03:33.371901 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.371819 2574 generic.go:356] "Generic (PLEG): container finished" podID="d778383c-ee92-4a47-a273-239a355ef87b" containerID="71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b" exitCode=0 Jul 14 14:03:33.371901 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.371859 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c87fd94db-jpd64" Jul 14 14:03:33.372343 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.371910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87fd94db-jpd64" event={"ID":"d778383c-ee92-4a47-a273-239a355ef87b","Type":"ContainerDied","Data":"71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b"} Jul 14 14:03:33.372343 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.371961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c87fd94db-jpd64" event={"ID":"d778383c-ee92-4a47-a273-239a355ef87b","Type":"ContainerDied","Data":"38208a41c8cfe906ff60d3b83d14877a693a85199e10a133ff43657018ffa816"} Jul 14 14:03:33.372343 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.371985 2574 scope.go:117] "RemoveContainer" containerID="71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b" Jul 14 14:03:33.381400 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.381382 2574 scope.go:117] "RemoveContainer" containerID="71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b" Jul 14 14:03:33.381650 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:03:33.381630 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b\": container with ID starting with 71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b not found: ID does not exist" containerID="71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b" Jul 14 14:03:33.381711 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.381658 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b"} err="failed to get container status \"71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b\": rpc error: code = NotFound desc = could not find container \"71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b\": container with ID starting with 71573196f2006802f7a0ed4e59f3a8f72e21a3626f6c91eae0795f9fc97dc73b not found: ID does not exist" Jul 14 14:03:33.403582 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.403557 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c87fd94db-jpd64"] Jul 14 14:03:33.408446 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:33.408424 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c87fd94db-jpd64"] Jul 14 14:03:34.487431 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:34.487400 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d778383c-ee92-4a47-a273-239a355ef87b" path="/var/lib/kubelet/pods/d778383c-ee92-4a47-a273-239a355ef87b/volumes" Jul 14 14:03:52.393824 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:52.393796 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:03:52.401530 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:52.401509 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:03:52.401746 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:52.401730 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:03:52.409388 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:52.409359 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:03:53.852850 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.852815 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99"] Jul 14 14:03:53.853252 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.853207 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d778383c-ee92-4a47-a273-239a355ef87b" containerName="manager" Jul 14 14:03:53.853252 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.853220 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d778383c-ee92-4a47-a273-239a355ef87b" containerName="manager" Jul 14 14:03:53.853345 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.853285 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d778383c-ee92-4a47-a273-239a355ef87b" containerName="manager" Jul 14 14:03:53.858971 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.858951 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:53.866213 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.866172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-znm9j\"" Jul 14 14:03:53.866314 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.866216 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 14:03:53.887404 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.887373 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99"] Jul 14 14:03:53.980126 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.980094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ba9495-1b0a-4569-a2ed-5be6e254543d-maas-api-tls\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:53.980126 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.980129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ba9495-1b0a-4569-a2ed-5be6e254543d-openshift-service-ca\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:53.980367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:53.980176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psg6h\" (UniqueName: \"kubernetes.io/projected/14ba9495-1b0a-4569-a2ed-5be6e254543d-kube-api-access-psg6h\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.080645 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.080613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psg6h\" (UniqueName: \"kubernetes.io/projected/14ba9495-1b0a-4569-a2ed-5be6e254543d-kube-api-access-psg6h\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.080836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.080693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ba9495-1b0a-4569-a2ed-5be6e254543d-maas-api-tls\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.080836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.080712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ba9495-1b0a-4569-a2ed-5be6e254543d-openshift-service-ca\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.081469 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.081445 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14ba9495-1b0a-4569-a2ed-5be6e254543d-openshift-service-ca\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.083214 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.083154 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14ba9495-1b0a-4569-a2ed-5be6e254543d-maas-api-tls\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.091335 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.091315 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psg6h\" (UniqueName: \"kubernetes.io/projected/14ba9495-1b0a-4569-a2ed-5be6e254543d-kube-api-access-psg6h\") pod \"maas-api-5d88856d7b-cgb99\" (UID: \"14ba9495-1b0a-4569-a2ed-5be6e254543d\") " pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.169776 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.169746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:54.316875 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.316847 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99"] Jul 14 14:03:54.318660 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:03:54.318630 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ba9495_1b0a_4569_a2ed_5be6e254543d.slice/crio-150f97aa5178ae9ea56da330925809877b60dac9f86392bff3fcab15da5d4e66 WatchSource:0}: Error finding container 150f97aa5178ae9ea56da330925809877b60dac9f86392bff3fcab15da5d4e66: Status 404 returned error can't find the container with id 150f97aa5178ae9ea56da330925809877b60dac9f86392bff3fcab15da5d4e66 Jul 14 14:03:54.478894 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.478804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" event={"ID":"14ba9495-1b0a-4569-a2ed-5be6e254543d","Type":"ContainerStarted","Data":"150f97aa5178ae9ea56da330925809877b60dac9f86392bff3fcab15da5d4e66"} Jul 14 14:03:54.681119 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.681089 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-njlb9"] Jul 14 14:03:54.685689 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.685666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.690356 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.690334 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 14:03:54.699757 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.699733 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-njlb9"] Jul 14 14:03:54.786602 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.786515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81e564e-dce5-425f-b198-2984331d6ff3-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-njlb9\" (UID: \"a81e564e-dce5-425f-b198-2984331d6ff3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.786602 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.786579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jwp7\" (UniqueName: \"kubernetes.io/projected/a81e564e-dce5-425f-b198-2984331d6ff3-kube-api-access-9jwp7\") pod \"payload-pre-processing-74584bb9f8-njlb9\" (UID: \"a81e564e-dce5-425f-b198-2984331d6ff3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.887914 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.887878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jwp7\" (UniqueName: \"kubernetes.io/projected/a81e564e-dce5-425f-b198-2984331d6ff3-kube-api-access-9jwp7\") pod \"payload-pre-processing-74584bb9f8-njlb9\" (UID: \"a81e564e-dce5-425f-b198-2984331d6ff3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.888311 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.887965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81e564e-dce5-425f-b198-2984331d6ff3-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-njlb9\" (UID: \"a81e564e-dce5-425f-b198-2984331d6ff3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.888656 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.888638 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81e564e-dce5-425f-b198-2984331d6ff3-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-njlb9\" (UID: \"a81e564e-dce5-425f-b198-2984331d6ff3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.919859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.919832 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jwp7\" (UniqueName: \"kubernetes.io/projected/a81e564e-dce5-425f-b198-2984331d6ff3-kube-api-access-9jwp7\") pod \"payload-pre-processing-74584bb9f8-njlb9\" (UID: \"a81e564e-dce5-425f-b198-2984331d6ff3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:54.996867 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:54.996839 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:55.150804 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:55.150776 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-njlb9"] Jul 14 14:03:55.153638 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:03:55.153610 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81e564e_dce5_425f_b198_2984331d6ff3.slice/crio-480ec69d913a7ebebb1d52f84c6cafa1aac46fd8633a886e90b02d848b5d73c9 WatchSource:0}: Error finding container 480ec69d913a7ebebb1d52f84c6cafa1aac46fd8633a886e90b02d848b5d73c9: Status 404 returned error can't find the container with id 480ec69d913a7ebebb1d52f84c6cafa1aac46fd8633a886e90b02d848b5d73c9 Jul 14 14:03:55.485200 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:55.485156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" event={"ID":"a81e564e-dce5-425f-b198-2984331d6ff3","Type":"ContainerStarted","Data":"480ec69d913a7ebebb1d52f84c6cafa1aac46fd8633a886e90b02d848b5d73c9"} Jul 14 14:03:57.503783 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:57.503744 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" event={"ID":"14ba9495-1b0a-4569-a2ed-5be6e254543d","Type":"ContainerStarted","Data":"c3f87309b0ef5a0bbe459c2c34fcc531f8bc348ed3caecd940a7c693fdefd3a3"} Jul 14 14:03:57.506255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:57.503888 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:03:57.506255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:57.505314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" event={"ID":"a81e564e-dce5-425f-b198-2984331d6ff3","Type":"ContainerStarted","Data":"4a6944f9c0377ce9f0f82ee722922ce72a4042487dbc82678790df80ed69db26"} Jul 14 14:03:57.506255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:57.505354 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:03:57.522845 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:57.522799 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" podStartSLOduration=2.194110168 podStartE2EDuration="4.522785846s" totalImagesPullingTime="2.328675678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:03:57.521675935 +0000 UTC m=+605.589774793" watchObservedRunningTime="2026-07-14 14:03:57.522785846 +0000 UTC m=+605.590884757" Jul 14 14:03:57.536445 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:03:57.536402 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" podStartSLOduration=2.040903477 podStartE2EDuration="3.536385717s" totalImagesPullingTime="1.49548224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:03:57.535612796 +0000 UTC m=+605.603711672" watchObservedRunningTime="2026-07-14 14:03:57.536385717 +0000 UTC m=+605.604484573" Jul 14 14:04:03.515689 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:03.515660 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d88856d7b-cgb99" Jul 14 14:04:08.512398 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:08.512369 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-njlb9" Jul 14 14:04:53.288343 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.288307 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r"] Jul 14 14:04:53.292068 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.292046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.295635 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.295605 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 14:04:53.295861 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.295663 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 14:04:53.295861 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.295669 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6dw7s\"" Jul 14 14:04:53.295861 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.295684 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 14:04:53.301740 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.301717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r"] Jul 14 14:04:53.372318 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.372281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.372503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.372326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.372503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.372383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8100ced-171b-4430-8f8f-4ce728d28e3f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.372503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.372440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.372503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.372496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.372691 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.372551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq4j5\" (UniqueName: \"kubernetes.io/projected/b8100ced-171b-4430-8f8f-4ce728d28e3f-kube-api-access-mq4j5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473373 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473566 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8100ced-171b-4430-8f8f-4ce728d28e3f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473566 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473566 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473566 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq4j5\" (UniqueName: \"kubernetes.io/projected/b8100ced-171b-4430-8f8f-4ce728d28e3f-kube-api-access-mq4j5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473566 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473835 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473931 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473907 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.473987 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.473968 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.475806 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.475783 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8100ced-171b-4430-8f8f-4ce728d28e3f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.476107 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.476085 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8100ced-171b-4430-8f8f-4ce728d28e3f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.494991 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.494961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq4j5\" (UniqueName: \"kubernetes.io/projected/b8100ced-171b-4430-8f8f-4ce728d28e3f-kube-api-access-mq4j5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7m8r\" (UID: \"b8100ced-171b-4430-8f8f-4ce728d28e3f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.603391 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.603314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:04:53.748045 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.748019 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r"] Jul 14 14:04:53.749921 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:04:53.749891 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8100ced_171b_4430_8f8f_4ce728d28e3f.slice/crio-ecfd9545395eb03e6e4a7de1e0a042c3ebf98c6fdcb26e35b6d980098875646e WatchSource:0}: Error finding container ecfd9545395eb03e6e4a7de1e0a042c3ebf98c6fdcb26e35b6d980098875646e: Status 404 returned error can't find the container with id ecfd9545395eb03e6e4a7de1e0a042c3ebf98c6fdcb26e35b6d980098875646e Jul 14 14:04:53.751479 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.751460 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:04:53.775573 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:53.775542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" event={"ID":"b8100ced-171b-4430-8f8f-4ce728d28e3f","Type":"ContainerStarted","Data":"ecfd9545395eb03e6e4a7de1e0a042c3ebf98c6fdcb26e35b6d980098875646e"} Jul 14 14:04:55.788168 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:55.788125 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" event={"ID":"b8100ced-171b-4430-8f8f-4ce728d28e3f","Type":"ContainerStarted","Data":"f18b3de7f64c6539736b323db6994389b1bb7022285785b26064831c37d2ed80"} Jul 14 14:04:55.807895 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:04:55.807843 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" podStartSLOduration=1.74606847 podStartE2EDuration="2.807827606s" totalImagesPullingTime="1.061759136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:04:55.805889948 +0000 UTC m=+663.873988803" watchObservedRunningTime="2026-07-14 14:04:55.807827606 +0000 UTC m=+663.875926461" Jul 14 14:05:03.603881 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:03.603848 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:05:03.604335 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:03.603906 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:05:03.616433 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:03.616409 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:05:03.840234 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:03.840207 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7m8r" Jul 14 14:05:09.084851 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.084820 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7"] Jul 14 14:05:09.090840 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.090820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.093208 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.093174 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 14:05:09.100768 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.100740 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7"] Jul 14 14:05:09.214913 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.214884 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0987301-2f15-4a2e-b059-d95e40a8f761-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.214913 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.214917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.215140 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.214938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.215140 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.215055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.215140 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.215095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgft\" (UniqueName: \"kubernetes.io/projected/f0987301-2f15-4a2e-b059-d95e40a8f761-kube-api-access-ncgft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.215287 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.215213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.315975 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.315936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgft\" (UniqueName: \"kubernetes.io/projected/f0987301-2f15-4a2e-b059-d95e40a8f761-kube-api-access-ncgft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316142 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.315992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316142 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0987301-2f15-4a2e-b059-d95e40a8f761-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316142 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316142 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316341 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316526 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316498 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316702 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.316702 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.316637 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.318345 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.318321 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0987301-2f15-4a2e-b059-d95e40a8f761-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.318624 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.318605 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0987301-2f15-4a2e-b059-d95e40a8f761-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.324126 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.324108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgft\" (UniqueName: \"kubernetes.io/projected/f0987301-2f15-4a2e-b059-d95e40a8f761-kube-api-access-ncgft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7prx7\" (UID: \"f0987301-2f15-4a2e-b059-d95e40a8f761\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.404435 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.404347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:09.539739 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.539709 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7"] Jul 14 14:05:09.541427 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:05:09.541399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0987301_2f15_4a2e_b059_d95e40a8f761.slice/crio-e34b97e592a60f5ab8f9dbed677ed636c2e9d0e44a8457704e64d502ee773f09 WatchSource:0}: Error finding container e34b97e592a60f5ab8f9dbed677ed636c2e9d0e44a8457704e64d502ee773f09: Status 404 returned error can't find the container with id e34b97e592a60f5ab8f9dbed677ed636c2e9d0e44a8457704e64d502ee773f09 Jul 14 14:05:09.859898 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:09.859867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" event={"ID":"f0987301-2f15-4a2e-b059-d95e40a8f761","Type":"ContainerStarted","Data":"e34b97e592a60f5ab8f9dbed677ed636c2e9d0e44a8457704e64d502ee773f09"} Jul 14 14:05:10.867288 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:10.867215 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" event={"ID":"f0987301-2f15-4a2e-b059-d95e40a8f761","Type":"ContainerStarted","Data":"47325a07afdbc8405b9049fd2961ae66c44dce9fe80a747ebceed6902f76c656"} Jul 14 14:05:10.890780 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:10.890721 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" podStartSLOduration=1.619875901 podStartE2EDuration="1.890694739s" totalImagesPullingTime="270.818838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:05:10.888813979 +0000 UTC m=+678.956912834" watchObservedRunningTime="2026-07-14 14:05:10.890694739 +0000 UTC m=+678.958793594" Jul 14 14:05:19.405163 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:19.405129 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:19.405540 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:19.405216 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:19.417759 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:19.417733 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:19.921987 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:19.921956 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7prx7" Jul 14 14:05:27.077442 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.077408 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq"] Jul 14 14:05:27.081490 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.081468 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.083766 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.083738 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 14:05:27.091817 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.091788 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq"] Jul 14 14:05:27.174070 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.174038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.174070 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.174070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.174301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.174104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.174301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.174150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4cx\" (UniqueName: \"kubernetes.io/projected/beaedf62-1915-4798-b925-e85be9a8fb15-kube-api-access-mh4cx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.174301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.174203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaedf62-1915-4798-b925-e85be9a8fb15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.174301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.174275 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.274790 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.274762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.274954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.274811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.274954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.274827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.274954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.274873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.274954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.274895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4cx\" (UniqueName: \"kubernetes.io/projected/beaedf62-1915-4798-b925-e85be9a8fb15-kube-api-access-mh4cx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.274954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.274918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaedf62-1915-4798-b925-e85be9a8fb15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.275293 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.275269 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.275365 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.275302 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.275475 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.275456 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.277284 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.277260 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaedf62-1915-4798-b925-e85be9a8fb15-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.277578 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.277561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaedf62-1915-4798-b925-e85be9a8fb15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.286899 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.286877 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4cx\" (UniqueName: \"kubernetes.io/projected/beaedf62-1915-4798-b925-e85be9a8fb15-kube-api-access-mh4cx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx5hq\" (UID: \"beaedf62-1915-4798-b925-e85be9a8fb15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.393709 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.393645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:27.534819 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.534794 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq"] Jul 14 14:05:27.536994 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:05:27.536967 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeaedf62_1915_4798_b925_e85be9a8fb15.slice/crio-779e0a4f7118b39a91c61dc0af60c26719c766278b195d24a47072a1572e4689 WatchSource:0}: Error finding container 779e0a4f7118b39a91c61dc0af60c26719c766278b195d24a47072a1572e4689: Status 404 returned error can't find the container with id 779e0a4f7118b39a91c61dc0af60c26719c766278b195d24a47072a1572e4689 Jul 14 14:05:27.949524 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.949494 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" event={"ID":"beaedf62-1915-4798-b925-e85be9a8fb15","Type":"ContainerStarted","Data":"2878ba4c3c29ce6dd26a21e3ff474c3df5c988f8ac2f0f3e217242cbf6b0dfca"} Jul 14 14:05:27.949690 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.949551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" event={"ID":"beaedf62-1915-4798-b925-e85be9a8fb15","Type":"ContainerStarted","Data":"779e0a4f7118b39a91c61dc0af60c26719c766278b195d24a47072a1572e4689"} Jul 14 14:05:27.968777 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:27.968727 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" podStartSLOduration=0.669687197 podStartE2EDuration="968.707683ms" totalImagesPullingTime="299.020486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:05:27.967375904 +0000 UTC m=+696.035474779" watchObservedRunningTime="2026-07-14 14:05:27.968707683 +0000 UTC m=+696.036806537" Jul 14 14:05:37.394465 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:37.394415 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:37.394465 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:37.394485 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:37.407105 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:37.407081 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:05:38.012222 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:05:38.012176 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx5hq" Jul 14 14:08:01.897303 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:01.897266 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-2swxw"] Jul 14 14:08:01.897847 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:01.897479 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bdf659b57-2swxw" podUID="4ae41535-e3c1-4af2-8f1c-56c425b7a68a" containerName="manager" containerID="cri-o://26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3" gracePeriod=30 Jul 14 14:08:02.153500 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.153439 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:08:02.265750 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.265716 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8dwk\" (UniqueName: \"kubernetes.io/projected/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-kube-api-access-r8dwk\") pod \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " Jul 14 14:08:02.265914 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.265804 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-webhook-cert\") pod \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\" (UID: \"4ae41535-e3c1-4af2-8f1c-56c425b7a68a\") " Jul 14 14:08:02.267863 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.267826 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-kube-api-access-r8dwk" (OuterVolumeSpecName: "kube-api-access-r8dwk") pod "4ae41535-e3c1-4af2-8f1c-56c425b7a68a" (UID: "4ae41535-e3c1-4af2-8f1c-56c425b7a68a"). InnerVolumeSpecName "kube-api-access-r8dwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:08:02.267977 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.267880 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4ae41535-e3c1-4af2-8f1c-56c425b7a68a" (UID: "4ae41535-e3c1-4af2-8f1c-56c425b7a68a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:08:02.367433 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.367400 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-webhook-cert\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:08:02.367433 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.367427 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8dwk\" (UniqueName: \"kubernetes.io/projected/4ae41535-e3c1-4af2-8f1c-56c425b7a68a-kube-api-access-r8dwk\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:08:02.744400 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.744369 2574 generic.go:356] "Generic (PLEG): container finished" podID="4ae41535-e3c1-4af2-8f1c-56c425b7a68a" containerID="26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3" exitCode=0 Jul 14 14:08:02.744565 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.744410 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bdf659b57-2swxw" Jul 14 14:08:02.744565 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.744428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bdf659b57-2swxw" event={"ID":"4ae41535-e3c1-4af2-8f1c-56c425b7a68a","Type":"ContainerDied","Data":"26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3"} Jul 14 14:08:02.744565 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.744467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bdf659b57-2swxw" event={"ID":"4ae41535-e3c1-4af2-8f1c-56c425b7a68a","Type":"ContainerDied","Data":"4f973b6fd36826463f9ebda14c72f160483fd1548884fe162919584658ca1c70"} Jul 14 14:08:02.744565 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.744488 2574 scope.go:117] "RemoveContainer" containerID="26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3" Jul 14 14:08:02.754335 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.754316 2574 scope.go:117] "RemoveContainer" containerID="26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3" Jul 14 14:08:02.754602 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:08:02.754583 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3\": container with ID starting with 26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3 not found: ID does not exist" containerID="26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3" Jul 14 14:08:02.754674 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.754612 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3"} err="failed to get container status \"26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3\": rpc error: code = NotFound desc = could not find container \"26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3\": container with ID starting with 26aaebdd9630ae9557c08bd7f92a10b95a7db03f1cfad0f5d1c942283e9cb4a3 not found: ID does not exist" Jul 14 14:08:02.767091 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.767067 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-2swxw"] Jul 14 14:08:02.772250 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:02.772228 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-2swxw"] Jul 14 14:08:03.620910 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.620878 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bdf659b57-9hlf9"] Jul 14 14:08:03.621403 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.621383 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae41535-e3c1-4af2-8f1c-56c425b7a68a" containerName="manager" Jul 14 14:08:03.621479 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.621406 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae41535-e3c1-4af2-8f1c-56c425b7a68a" containerName="manager" Jul 14 14:08:03.621547 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.621536 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae41535-e3c1-4af2-8f1c-56c425b7a68a" containerName="manager" Jul 14 14:08:03.625691 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.625676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.628852 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.628830 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 14:08:03.628970 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.628852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-42t4s\"" Jul 14 14:08:03.628970 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.628838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 14:08:03.636153 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.636132 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-9hlf9"] Jul 14 14:08:03.678150 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.678119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vhx\" (UniqueName: \"kubernetes.io/projected/6dd261a6-305a-4166-9448-a0f4cb5f9a25-kube-api-access-x8vhx\") pod \"maas-controller-6bdf659b57-9hlf9\" (UID: \"6dd261a6-305a-4166-9448-a0f4cb5f9a25\") " pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.678305 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.678228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd261a6-305a-4166-9448-a0f4cb5f9a25-webhook-cert\") pod \"maas-controller-6bdf659b57-9hlf9\" (UID: \"6dd261a6-305a-4166-9448-a0f4cb5f9a25\") " pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.778972 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.778943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vhx\" (UniqueName: \"kubernetes.io/projected/6dd261a6-305a-4166-9448-a0f4cb5f9a25-kube-api-access-x8vhx\") pod \"maas-controller-6bdf659b57-9hlf9\" (UID: \"6dd261a6-305a-4166-9448-a0f4cb5f9a25\") " pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.779131 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.779005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd261a6-305a-4166-9448-a0f4cb5f9a25-webhook-cert\") pod \"maas-controller-6bdf659b57-9hlf9\" (UID: \"6dd261a6-305a-4166-9448-a0f4cb5f9a25\") " pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.781491 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.781472 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd261a6-305a-4166-9448-a0f4cb5f9a25-webhook-cert\") pod \"maas-controller-6bdf659b57-9hlf9\" (UID: \"6dd261a6-305a-4166-9448-a0f4cb5f9a25\") " pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.787393 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.787373 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vhx\" (UniqueName: \"kubernetes.io/projected/6dd261a6-305a-4166-9448-a0f4cb5f9a25-kube-api-access-x8vhx\") pod \"maas-controller-6bdf659b57-9hlf9\" (UID: \"6dd261a6-305a-4166-9448-a0f4cb5f9a25\") " pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:03.936603 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:03.936571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:04.073202 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:04.073100 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bdf659b57-9hlf9"] Jul 14 14:08:04.075725 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:08:04.075698 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd261a6_305a_4166_9448_a0f4cb5f9a25.slice/crio-87e544afb46afc3c087f401cc54baeb41665381994b21746ec9287f76aeb05ba WatchSource:0}: Error finding container 87e544afb46afc3c087f401cc54baeb41665381994b21746ec9287f76aeb05ba: Status 404 returned error can't find the container with id 87e544afb46afc3c087f401cc54baeb41665381994b21746ec9287f76aeb05ba Jul 14 14:08:04.488135 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:04.488093 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae41535-e3c1-4af2-8f1c-56c425b7a68a" path="/var/lib/kubelet/pods/4ae41535-e3c1-4af2-8f1c-56c425b7a68a/volumes" Jul 14 14:08:04.756732 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:04.756639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" event={"ID":"6dd261a6-305a-4166-9448-a0f4cb5f9a25","Type":"ContainerStarted","Data":"1b5951624a17048f15aaa0f9d76f2aeb4ea55ba421a6a05381690f0dd8d76a5c"} Jul 14 14:08:04.756732 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:04.756695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" event={"ID":"6dd261a6-305a-4166-9448-a0f4cb5f9a25","Type":"ContainerStarted","Data":"87e544afb46afc3c087f401cc54baeb41665381994b21746ec9287f76aeb05ba"} Jul 14 14:08:04.757125 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:04.756752 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:15.763643 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:15.763606 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" Jul 14 14:08:15.785699 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:15.785607 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bdf659b57-9hlf9" podStartSLOduration=12.325501709 podStartE2EDuration="12.785587289s" totalImagesPullingTime="460.08558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:08:04.776101623 +0000 UTC m=+852.844200499" watchObservedRunningTime="2026-07-14 14:08:15.785587289 +0000 UTC m=+863.853686144" Jul 14 14:08:52.427397 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:52.427369 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:08:52.435932 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:52.435909 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:08:52.437541 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:52.437524 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:08:52.443974 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:08:52.443958 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:12:53.802157 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:53.802117 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p"] Jul 14 14:12:53.802689 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:53.802372 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" podUID="236b51b6-7854-4fc1-aa66-1d2ff1d813b0" containerName="manager" containerID="cri-o://8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b" gracePeriod=10 Jul 14 14:12:55.572498 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.572468 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:12:55.671964 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.671910 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-extensions-socket-volume\") pod \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " Jul 14 14:12:55.672209 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.671997 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnkvm\" (UniqueName: \"kubernetes.io/projected/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-kube-api-access-xnkvm\") pod \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\" (UID: \"236b51b6-7854-4fc1-aa66-1d2ff1d813b0\") " Jul 14 14:12:55.672296 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.672265 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "236b51b6-7854-4fc1-aa66-1d2ff1d813b0" (UID: "236b51b6-7854-4fc1-aa66-1d2ff1d813b0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:12:55.672373 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.672358 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-extensions-socket-volume\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:12:55.674115 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.674085 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-kube-api-access-xnkvm" (OuterVolumeSpecName: "kube-api-access-xnkvm") pod "236b51b6-7854-4fc1-aa66-1d2ff1d813b0" (UID: "236b51b6-7854-4fc1-aa66-1d2ff1d813b0"). InnerVolumeSpecName "kube-api-access-xnkvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:12:55.773819 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:55.773775 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnkvm\" (UniqueName: \"kubernetes.io/projected/236b51b6-7854-4fc1-aa66-1d2ff1d813b0-kube-api-access-xnkvm\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:12:56.259160 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.259124 2574 generic.go:356] "Generic (PLEG): container finished" podID="236b51b6-7854-4fc1-aa66-1d2ff1d813b0" containerID="8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b" exitCode=0 Jul 14 14:12:56.259350 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.259215 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" Jul 14 14:12:56.259350 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.259214 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" event={"ID":"236b51b6-7854-4fc1-aa66-1d2ff1d813b0","Type":"ContainerDied","Data":"8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b"} Jul 14 14:12:56.259350 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.259321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p" event={"ID":"236b51b6-7854-4fc1-aa66-1d2ff1d813b0","Type":"ContainerDied","Data":"fb93e20e003b1e55aab6746fa8bf55d5c7fa77bb2aed4bc53f02548a1fbd86e8"} Jul 14 14:12:56.259454 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.259351 2574 scope.go:117] "RemoveContainer" containerID="8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b" Jul 14 14:12:56.269382 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.269366 2574 scope.go:117] "RemoveContainer" containerID="8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b" Jul 14 14:12:56.269655 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:12:56.269633 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b\": container with ID starting with 8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b not found: ID does not exist" containerID="8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b" Jul 14 14:12:56.269723 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.269663 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b"} err="failed to get container status \"8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b\": rpc error: code = NotFound desc = could not find container \"8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b\": container with ID starting with 8ddc1c0a2e74193dd8cef5b54194cffc3e0ec3864a98b2019869c1a5aa957a4b not found: ID does not exist" Jul 14 14:12:56.281326 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.281299 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p"] Jul 14 14:12:56.287750 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.287723 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rjg2p"] Jul 14 14:12:56.487336 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:12:56.487306 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="236b51b6-7854-4fc1-aa66-1d2ff1d813b0" path="/var/lib/kubelet/pods/236b51b6-7854-4fc1-aa66-1d2ff1d813b0/volumes" Jul 14 14:13:52.463242 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:52.463209 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:13:52.466574 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:52.466553 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:13:52.470810 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:52.470789 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:13:52.474085 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:52.474066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:13:55.045817 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.045781 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r"] Jul 14 14:13:55.046286 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.046269 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236b51b6-7854-4fc1-aa66-1d2ff1d813b0" containerName="manager" Jul 14 14:13:55.046286 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.046287 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="236b51b6-7854-4fc1-aa66-1d2ff1d813b0" containerName="manager" Jul 14 14:13:55.046423 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.046364 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="236b51b6-7854-4fc1-aa66-1d2ff1d813b0" containerName="manager" Jul 14 14:13:55.049801 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.049785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.052208 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.052174 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kzqv7\"" Jul 14 14:13:55.059954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.059930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r"] Jul 14 14:13:55.116463 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.116427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/701da5ab-4814-4911-8caf-84452fcd2033-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hdm5r\" (UID: \"701da5ab-4814-4911-8caf-84452fcd2033\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.116637 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.116494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4flt\" (UniqueName: \"kubernetes.io/projected/701da5ab-4814-4911-8caf-84452fcd2033-kube-api-access-s4flt\") pod \"kuadrant-operator-controller-manager-86878c769f-hdm5r\" (UID: \"701da5ab-4814-4911-8caf-84452fcd2033\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.217121 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.217079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4flt\" (UniqueName: \"kubernetes.io/projected/701da5ab-4814-4911-8caf-84452fcd2033-kube-api-access-s4flt\") pod \"kuadrant-operator-controller-manager-86878c769f-hdm5r\" (UID: \"701da5ab-4814-4911-8caf-84452fcd2033\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.217325 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.217179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/701da5ab-4814-4911-8caf-84452fcd2033-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hdm5r\" (UID: \"701da5ab-4814-4911-8caf-84452fcd2033\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.217551 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.217533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/701da5ab-4814-4911-8caf-84452fcd2033-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hdm5r\" (UID: \"701da5ab-4814-4911-8caf-84452fcd2033\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.230722 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.230690 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4flt\" (UniqueName: \"kubernetes.io/projected/701da5ab-4814-4911-8caf-84452fcd2033-kube-api-access-s4flt\") pod \"kuadrant-operator-controller-manager-86878c769f-hdm5r\" (UID: \"701da5ab-4814-4911-8caf-84452fcd2033\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.361164 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.361056 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:55.513293 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.513263 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r"] Jul 14 14:13:55.516883 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:13:55.516853 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701da5ab_4814_4911_8caf_84452fcd2033.slice/crio-52945bfaec1edc6a6176746fbffa2cb78eabfabb1ea72e66e357fc027a194a51 WatchSource:0}: Error finding container 52945bfaec1edc6a6176746fbffa2cb78eabfabb1ea72e66e357fc027a194a51: Status 404 returned error can't find the container with id 52945bfaec1edc6a6176746fbffa2cb78eabfabb1ea72e66e357fc027a194a51 Jul 14 14:13:55.551238 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:55.551213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" event={"ID":"701da5ab-4814-4911-8caf-84452fcd2033","Type":"ContainerStarted","Data":"52945bfaec1edc6a6176746fbffa2cb78eabfabb1ea72e66e357fc027a194a51"} Jul 14 14:13:56.557968 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:56.557932 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" event={"ID":"701da5ab-4814-4911-8caf-84452fcd2033","Type":"ContainerStarted","Data":"a8654cd1f32f6c275f28f05e406a27f17d90e3cc316f30cac116938c1be59e05"} Jul 14 14:13:56.558414 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:56.558024 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:13:56.589914 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:13:56.589862 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" podStartSLOduration=1.589847445 podStartE2EDuration="1.589847445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:13:56.588644621 +0000 UTC m=+1204.656743475" watchObservedRunningTime="2026-07-14 14:13:56.589847445 +0000 UTC m=+1204.657946299" Jul 14 14:14:07.565514 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:14:07.565487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hdm5r" Jul 14 14:18:52.504064 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:18:52.504035 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:18:52.505675 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:18:52.505650 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:18:52.511859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:18:52.511836 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:18:52.513445 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:18:52.513424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:19:52.024412 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.024373 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp"] Jul 14 14:19:52.028848 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.028828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.030961 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.030940 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4f7140c9-serving-cert\"" Jul 14 14:19:52.036503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.036464 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp"] Jul 14 14:19:52.098986 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.098955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgb86\" (UniqueName: \"kubernetes.io/projected/0a74451e-ac5f-4401-872b-724255a4ff88-kube-api-access-xgb86\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.099145 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.099080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a74451e-ac5f-4401-872b-724255a4ff88-openshift-service-ca\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.099145 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.099118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.200375 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.200335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgb86\" (UniqueName: \"kubernetes.io/projected/0a74451e-ac5f-4401-872b-724255a4ff88-kube-api-access-xgb86\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.200556 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.200454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a74451e-ac5f-4401-872b-724255a4ff88-openshift-service-ca\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.200556 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.200487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.200678 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:19:52.200634 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-serving-cert: secret "maas-api-e2e-ait-4f7140c9-serving-cert" not found Jul 14 14:19:52.200732 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:19:52.200719 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls podName:0a74451e-ac5f-4401-872b-724255a4ff88 nodeName:}" failed. No retries permitted until 2026-07-14 14:19:52.700695981 +0000 UTC m=+1560.768794840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls") pod "maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" (UID: "0a74451e-ac5f-4401-872b-724255a4ff88") : secret "maas-api-e2e-ait-4f7140c9-serving-cert" not found Jul 14 14:19:52.201152 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.201131 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a74451e-ac5f-4401-872b-724255a4ff88-openshift-service-ca\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.210753 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.210729 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgb86\" (UniqueName: \"kubernetes.io/projected/0a74451e-ac5f-4401-872b-724255a4ff88-kube-api-access-xgb86\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.704248 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.704202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.706660 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.706628 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls\") pod \"maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:52.941070 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:52.941037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:53.088656 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:53.088631 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp"] Jul 14 14:19:53.090742 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:19:53.090703 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a74451e_ac5f_4401_872b_724255a4ff88.slice/crio-e7243368ed06d52ccfca83095b7bf78f05725f6a197643560a5cc365319dd246 WatchSource:0}: Error finding container e7243368ed06d52ccfca83095b7bf78f05725f6a197643560a5cc365319dd246: Status 404 returned error can't find the container with id e7243368ed06d52ccfca83095b7bf78f05725f6a197643560a5cc365319dd246 Jul 14 14:19:53.092610 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:53.092442 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:19:53.359759 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:53.359671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" event={"ID":"0a74451e-ac5f-4401-872b-724255a4ff88","Type":"ContainerStarted","Data":"e7243368ed06d52ccfca83095b7bf78f05725f6a197643560a5cc365319dd246"} Jul 14 14:19:54.366889 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:54.366852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" event={"ID":"0a74451e-ac5f-4401-872b-724255a4ff88","Type":"ContainerStarted","Data":"cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7"} Jul 14 14:19:54.367272 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:54.366916 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:19:54.389330 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:19:54.389279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" podStartSLOduration=1.291052918 podStartE2EDuration="2.389260733s" totalImagesPullingTime="1.098207815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:19:54.389090611 +0000 UTC m=+1562.457189492" watchObservedRunningTime="2026-07-14 14:19:54.389260733 +0000 UTC m=+1562.457359588" Jul 14 14:20:00.376497 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:00.376462 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:20:57.617088 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.617046 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp"] Jul 14 14:20:57.617726 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.617319 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" podUID="0a74451e-ac5f-4401-872b-724255a4ff88" containerName="maas-api" containerID="cri-o://cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7" gracePeriod=30 Jul 14 14:20:57.873727 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.873665 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:20:57.970820 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.970795 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgb86\" (UniqueName: \"kubernetes.io/projected/0a74451e-ac5f-4401-872b-724255a4ff88-kube-api-access-xgb86\") pod \"0a74451e-ac5f-4401-872b-724255a4ff88\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " Jul 14 14:20:57.970981 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.970832 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls\") pod \"0a74451e-ac5f-4401-872b-724255a4ff88\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " Jul 14 14:20:57.970981 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.970970 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a74451e-ac5f-4401-872b-724255a4ff88-openshift-service-ca\") pod \"0a74451e-ac5f-4401-872b-724255a4ff88\" (UID: \"0a74451e-ac5f-4401-872b-724255a4ff88\") " Jul 14 14:20:57.971380 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.971350 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a74451e-ac5f-4401-872b-724255a4ff88-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a74451e-ac5f-4401-872b-724255a4ff88" (UID: "0a74451e-ac5f-4401-872b-724255a4ff88"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:20:57.973034 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.973012 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a74451e-ac5f-4401-872b-724255a4ff88" (UID: "0a74451e-ac5f-4401-872b-724255a4ff88"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:20:57.973114 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:57.973081 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a74451e-ac5f-4401-872b-724255a4ff88-kube-api-access-xgb86" (OuterVolumeSpecName: "kube-api-access-xgb86") pod "0a74451e-ac5f-4401-872b-724255a4ff88" (UID: "0a74451e-ac5f-4401-872b-724255a4ff88"). InnerVolumeSpecName "kube-api-access-xgb86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:20:58.072081 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.072047 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a74451e-ac5f-4401-872b-724255a4ff88-openshift-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:20:58.072081 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.072076 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgb86\" (UniqueName: \"kubernetes.io/projected/0a74451e-ac5f-4401-872b-724255a4ff88-kube-api-access-xgb86\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:20:58.072303 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.072089 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a74451e-ac5f-4401-872b-724255a4ff88-maas-api-tls\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:20:58.694757 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.694713 2574 generic.go:356] "Generic (PLEG): container finished" podID="0a74451e-ac5f-4401-872b-724255a4ff88" containerID="cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7" exitCode=0 Jul 14 14:20:58.694757 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.694761 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" Jul 14 14:20:58.695246 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.694800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" event={"ID":"0a74451e-ac5f-4401-872b-724255a4ff88","Type":"ContainerDied","Data":"cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7"} Jul 14 14:20:58.695246 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.694852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp" event={"ID":"0a74451e-ac5f-4401-872b-724255a4ff88","Type":"ContainerDied","Data":"e7243368ed06d52ccfca83095b7bf78f05725f6a197643560a5cc365319dd246"} Jul 14 14:20:58.695246 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.694874 2574 scope.go:117] "RemoveContainer" containerID="cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7" Jul 14 14:20:58.703943 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.703926 2574 scope.go:117] "RemoveContainer" containerID="cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7" Jul 14 14:20:58.704212 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:20:58.704159 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7\": container with ID starting with cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7 not found: ID does not exist" containerID="cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7" Jul 14 14:20:58.704296 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.704225 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7"} err="failed to get container status \"cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7\": rpc error: code = NotFound desc = could not find container \"cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7\": container with ID starting with cb2f5f96ac62cd62e3d74866d1c12894378a631e8b57a6b4d0bfa388cb217bc7 not found: ID does not exist" Jul 14 14:20:58.712453 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.712429 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp"] Jul 14 14:20:58.716327 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:20:58.716305 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f7140c9-5f6679c74f-6cqdp"] Jul 14 14:21:00.488132 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:21:00.488102 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a74451e-ac5f-4401-872b-724255a4ff88" path="/var/lib/kubelet/pods/0a74451e-ac5f-4401-872b-724255a4ff88/volumes" Jul 14 14:22:34.178856 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.178823 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp"] Jul 14 14:22:34.179320 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.179305 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a74451e-ac5f-4401-872b-724255a4ff88" containerName="maas-api" Jul 14 14:22:34.179369 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.179323 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a74451e-ac5f-4401-872b-724255a4ff88" containerName="maas-api" Jul 14 14:22:34.179438 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.179427 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a74451e-ac5f-4401-872b-724255a4ff88" containerName="maas-api" Jul 14 14:22:34.184963 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.184940 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:34.189537 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.189406 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:22:34.191045 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.191024 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp"] Jul 14 14:22:34.196928 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.196902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b0ce3b-17dc-4be5-8683-5628f2374720-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp\" (UID: \"28b0ce3b-17dc-4be5-8683-5628f2374720\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:34.297752 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.297718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b0ce3b-17dc-4be5-8683-5628f2374720-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp\" (UID: \"28b0ce3b-17dc-4be5-8683-5628f2374720\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:34.298302 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.298286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b0ce3b-17dc-4be5-8683-5628f2374720-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp\" (UID: \"28b0ce3b-17dc-4be5-8683-5628f2374720\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:34.497861 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.497786 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:34.858887 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:34.858855 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp"] Jul 14 14:22:34.862148 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:22:34.862116 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b0ce3b_17dc_4be5_8683_5628f2374720.slice/crio-cfe40a041c7e8b1df231ffbf20ffe498514bc7d3ccbad95329abf1908fdae96f WatchSource:0}: Error finding container cfe40a041c7e8b1df231ffbf20ffe498514bc7d3ccbad95329abf1908fdae96f: Status 404 returned error can't find the container with id cfe40a041c7e8b1df231ffbf20ffe498514bc7d3ccbad95329abf1908fdae96f Jul 14 14:22:35.174806 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:35.174774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" event={"ID":"28b0ce3b-17dc-4be5-8683-5628f2374720","Type":"ContainerStarted","Data":"cfe40a041c7e8b1df231ffbf20ffe498514bc7d3ccbad95329abf1908fdae96f"} Jul 14 14:22:38.199313 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:38.199271 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b0ce3b-17dc-4be5-8683-5628f2374720" containerID="7a60e60985901d386db60043f9c04ce6887fd7a1128c1dc85a43dbed907b196d" exitCode=0 Jul 14 14:22:38.199674 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:38.199338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" event={"ID":"28b0ce3b-17dc-4be5-8683-5628f2374720","Type":"ContainerDied","Data":"7a60e60985901d386db60043f9c04ce6887fd7a1128c1dc85a43dbed907b196d"} Jul 14 14:22:39.342014 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:39.341985 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:39.444262 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:39.444230 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b0ce3b-17dc-4be5-8683-5628f2374720-maas-api-service-ca\") pod \"28b0ce3b-17dc-4be5-8683-5628f2374720\" (UID: \"28b0ce3b-17dc-4be5-8683-5628f2374720\") " Jul 14 14:22:39.444593 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:39.444567 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b0ce3b-17dc-4be5-8683-5628f2374720-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28b0ce3b-17dc-4be5-8683-5628f2374720" (UID: "28b0ce3b-17dc-4be5-8683-5628f2374720"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:22:39.545087 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:39.545007 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b0ce3b-17dc-4be5-8683-5628f2374720-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:22:40.210524 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:40.210494 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" Jul 14 14:22:40.210692 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:40.210503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp" event={"ID":"28b0ce3b-17dc-4be5-8683-5628f2374720","Type":"ContainerDied","Data":"cfe40a041c7e8b1df231ffbf20ffe498514bc7d3ccbad95329abf1908fdae96f"} Jul 14 14:22:40.210692 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:22:40.210610 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfe40a041c7e8b1df231ffbf20ffe498514bc7d3ccbad95329abf1908fdae96f" Jul 14 14:23:52.537525 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:52.537496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:23:52.538703 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:52.538685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:23:52.545230 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:52.545210 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:23:52.546309 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:52.546287 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:23:56.554895 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.554862 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9"] Jul 14 14:23:56.555284 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.555271 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b0ce3b-17dc-4be5-8683-5628f2374720" containerName="revoke-keys" Jul 14 14:23:56.555346 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.555286 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b0ce3b-17dc-4be5-8683-5628f2374720" containerName="revoke-keys" Jul 14 14:23:56.555387 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.555355 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b0ce3b-17dc-4be5-8683-5628f2374720" containerName="revoke-keys" Jul 14 14:23:56.558514 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.558494 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:23:56.561747 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.561725 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:23:56.569548 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.569473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9"] Jul 14 14:23:56.712030 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.712000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f09319-7308-456c-b3e6-294105cd3c21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9\" (UID: \"d4f09319-7308-456c-b3e6-294105cd3c21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:23:56.812806 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.812719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f09319-7308-456c-b3e6-294105cd3c21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9\" (UID: \"d4f09319-7308-456c-b3e6-294105cd3c21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:23:56.813364 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.813343 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f09319-7308-456c-b3e6-294105cd3c21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9\" (UID: \"d4f09319-7308-456c-b3e6-294105cd3c21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:23:56.871277 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:56.871251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:23:57.225757 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:57.225684 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9"] Jul 14 14:23:57.228414 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:23:57.228390 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f09319_7308_456c_b3e6_294105cd3c21.slice/crio-8029ac95e3debce2953b7222358bdfd265d0dc87966c022f04eb02beb534685f WatchSource:0}: Error finding container 8029ac95e3debce2953b7222358bdfd265d0dc87966c022f04eb02beb534685f: Status 404 returned error can't find the container with id 8029ac95e3debce2953b7222358bdfd265d0dc87966c022f04eb02beb534685f Jul 14 14:23:57.599923 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:57.599890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" event={"ID":"d4f09319-7308-456c-b3e6-294105cd3c21","Type":"ContainerStarted","Data":"0ba41aa2054d73079cb7704e54f9d5a8c2b2e0e85355a3e823a935d246ceebb2"} Jul 14 14:23:57.600302 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:57.599942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" event={"ID":"d4f09319-7308-456c-b3e6-294105cd3c21","Type":"ContainerStarted","Data":"8029ac95e3debce2953b7222358bdfd265d0dc87966c022f04eb02beb534685f"} Jul 14 14:23:57.617958 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:57.617916 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" podStartSLOduration=1.617901839 podStartE2EDuration="1.617901839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:23:57.616987539 +0000 UTC m=+1805.685086413" watchObservedRunningTime="2026-07-14 14:23:57.617901839 +0000 UTC m=+1805.686000722" Jul 14 14:23:58.606101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:58.606067 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4f09319-7308-456c-b3e6-294105cd3c21" containerID="0ba41aa2054d73079cb7704e54f9d5a8c2b2e0e85355a3e823a935d246ceebb2" exitCode=0 Jul 14 14:23:58.606516 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:58.606155 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" event={"ID":"d4f09319-7308-456c-b3e6-294105cd3c21","Type":"ContainerDied","Data":"0ba41aa2054d73079cb7704e54f9d5a8c2b2e0e85355a3e823a935d246ceebb2"} Jul 14 14:23:59.751715 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:59.751692 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:23:59.839416 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:59.839384 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f09319-7308-456c-b3e6-294105cd3c21-maas-api-service-ca\") pod \"d4f09319-7308-456c-b3e6-294105cd3c21\" (UID: \"d4f09319-7308-456c-b3e6-294105cd3c21\") " Jul 14 14:23:59.839705 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:59.839686 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f09319-7308-456c-b3e6-294105cd3c21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d4f09319-7308-456c-b3e6-294105cd3c21" (UID: "d4f09319-7308-456c-b3e6-294105cd3c21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:23:59.940572 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:23:59.940541 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f09319-7308-456c-b3e6-294105cd3c21-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:24:00.617697 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:24:00.617658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" event={"ID":"d4f09319-7308-456c-b3e6-294105cd3c21","Type":"ContainerDied","Data":"8029ac95e3debce2953b7222358bdfd265d0dc87966c022f04eb02beb534685f"} Jul 14 14:24:00.617697 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:24:00.617693 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9" Jul 14 14:24:00.617884 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:24:00.617719 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8029ac95e3debce2953b7222358bdfd265d0dc87966c022f04eb02beb534685f" Jul 14 14:26:18.951171 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.951133 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9"] Jul 14 14:26:18.951791 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.951768 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f09319-7308-456c-b3e6-294105cd3c21" containerName="revoke-keys" Jul 14 14:26:18.951835 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.951795 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f09319-7308-456c-b3e6-294105cd3c21" containerName="revoke-keys" Jul 14 14:26:18.951919 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.951908 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f09319-7308-456c-b3e6-294105cd3c21" containerName="revoke-keys" Jul 14 14:26:18.955645 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.955626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:26:18.958308 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.958282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:26:18.961860 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:18.961836 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9"] Jul 14 14:26:19.072150 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:19.072111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e907ff3f-2f3b-4108-947a-de624308cc7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9\" (UID: \"e907ff3f-2f3b-4108-947a-de624308cc7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:26:19.173507 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:19.173472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e907ff3f-2f3b-4108-947a-de624308cc7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9\" (UID: \"e907ff3f-2f3b-4108-947a-de624308cc7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:26:19.174367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:19.174347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e907ff3f-2f3b-4108-947a-de624308cc7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9\" (UID: \"e907ff3f-2f3b-4108-947a-de624308cc7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:26:19.267788 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:19.267708 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:26:19.613887 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:19.613803 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9"] Jul 14 14:26:19.617766 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:26:19.617737 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode907ff3f_2f3b_4108_947a_de624308cc7e.slice/crio-052b873fa8aed0a4295fae0fb06d4cfecf9bf656ad5d5217a77a76472e148dff WatchSource:0}: Error finding container 052b873fa8aed0a4295fae0fb06d4cfecf9bf656ad5d5217a77a76472e148dff: Status 404 returned error can't find the container with id 052b873fa8aed0a4295fae0fb06d4cfecf9bf656ad5d5217a77a76472e148dff Jul 14 14:26:20.335908 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:20.335870 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" event={"ID":"e907ff3f-2f3b-4108-947a-de624308cc7e","Type":"ContainerStarted","Data":"852af6b37432b573736a4d4f7874a4b7a18ae9cc1fbdef842b64371694d3a87f"} Jul 14 14:26:20.336373 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:20.335948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" event={"ID":"e907ff3f-2f3b-4108-947a-de624308cc7e","Type":"ContainerStarted","Data":"052b873fa8aed0a4295fae0fb06d4cfecf9bf656ad5d5217a77a76472e148dff"} Jul 14 14:26:20.358371 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:20.358325 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" podStartSLOduration=2.358310451 podStartE2EDuration="2.358310451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:26:20.355380759 +0000 UTC m=+1948.423479614" watchObservedRunningTime="2026-07-14 14:26:20.358310451 +0000 UTC m=+1948.426409305" Jul 14 14:26:21.343286 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:21.343246 2574 generic.go:356] "Generic (PLEG): container finished" podID="e907ff3f-2f3b-4108-947a-de624308cc7e" containerID="852af6b37432b573736a4d4f7874a4b7a18ae9cc1fbdef842b64371694d3a87f" exitCode=0 Jul 14 14:26:21.343706 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:21.343312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" event={"ID":"e907ff3f-2f3b-4108-947a-de624308cc7e","Type":"ContainerDied","Data":"852af6b37432b573736a4d4f7874a4b7a18ae9cc1fbdef842b64371694d3a87f"} Jul 14 14:26:22.487576 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:22.487553 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:26:22.604362 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:22.604290 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e907ff3f-2f3b-4108-947a-de624308cc7e-maas-api-service-ca\") pod \"e907ff3f-2f3b-4108-947a-de624308cc7e\" (UID: \"e907ff3f-2f3b-4108-947a-de624308cc7e\") " Jul 14 14:26:22.604650 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:22.604628 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e907ff3f-2f3b-4108-947a-de624308cc7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e907ff3f-2f3b-4108-947a-de624308cc7e" (UID: "e907ff3f-2f3b-4108-947a-de624308cc7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:26:22.705888 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:22.705860 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e907ff3f-2f3b-4108-947a-de624308cc7e-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:26:23.354466 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:23.354423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" event={"ID":"e907ff3f-2f3b-4108-947a-de624308cc7e","Type":"ContainerDied","Data":"052b873fa8aed0a4295fae0fb06d4cfecf9bf656ad5d5217a77a76472e148dff"} Jul 14 14:26:23.354693 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:23.354479 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="052b873fa8aed0a4295fae0fb06d4cfecf9bf656ad5d5217a77a76472e148dff" Jul 14 14:26:23.354693 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:26:23.354439 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9" Jul 14 14:28:52.573158 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:28:52.573129 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:28:52.575953 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:28:52.575931 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:28:52.580748 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:28:52.580730 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:28:52.583702 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:28:52.583686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:31:12.597193 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.597160 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8"] Jul 14 14:31:12.597679 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.597598 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e907ff3f-2f3b-4108-947a-de624308cc7e" containerName="revoke-keys" Jul 14 14:31:12.597679 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.597609 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e907ff3f-2f3b-4108-947a-de624308cc7e" containerName="revoke-keys" Jul 14 14:31:12.597762 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.597688 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e907ff3f-2f3b-4108-947a-de624308cc7e" containerName="revoke-keys" Jul 14 14:31:12.600831 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.600814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:12.605232 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.605210 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:31:12.622859 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.622835 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8"] Jul 14 14:31:12.720324 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.720289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ddd6b41-2874-4f0d-a168-4746db58dcd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8\" (UID: \"9ddd6b41-2874-4f0d-a168-4746db58dcd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:12.821743 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.821696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ddd6b41-2874-4f0d-a168-4746db58dcd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8\" (UID: \"9ddd6b41-2874-4f0d-a168-4746db58dcd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:12.822384 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.822362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ddd6b41-2874-4f0d-a168-4746db58dcd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8\" (UID: \"9ddd6b41-2874-4f0d-a168-4746db58dcd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:12.911411 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:12.911384 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:13.056509 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:13.056421 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8"] Jul 14 14:31:13.058797 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:31:13.058770 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ddd6b41_2874_4f0d_a168_4746db58dcd3.slice/crio-80e83ea3926f427eba978bb9eac1d6d281ecf21f2070b1ef9073535bdb6ebf92 WatchSource:0}: Error finding container 80e83ea3926f427eba978bb9eac1d6d281ecf21f2070b1ef9073535bdb6ebf92: Status 404 returned error can't find the container with id 80e83ea3926f427eba978bb9eac1d6d281ecf21f2070b1ef9073535bdb6ebf92 Jul 14 14:31:13.861736 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:13.861693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" event={"ID":"9ddd6b41-2874-4f0d-a168-4746db58dcd3","Type":"ContainerStarted","Data":"b97f9ecfd965b60d7aee2017e4d67da6764b8b1484fdcf4d492ac0c36f52e36e"} Jul 14 14:31:13.862101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:13.861801 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" event={"ID":"9ddd6b41-2874-4f0d-a168-4746db58dcd3","Type":"ContainerStarted","Data":"80e83ea3926f427eba978bb9eac1d6d281ecf21f2070b1ef9073535bdb6ebf92"} Jul 14 14:31:14.869333 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:14.869248 2574 generic.go:356] "Generic (PLEG): container finished" podID="9ddd6b41-2874-4f0d-a168-4746db58dcd3" containerID="b97f9ecfd965b60d7aee2017e4d67da6764b8b1484fdcf4d492ac0c36f52e36e" exitCode=0 Jul 14 14:31:14.869726 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:14.869336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" event={"ID":"9ddd6b41-2874-4f0d-a168-4746db58dcd3","Type":"ContainerDied","Data":"b97f9ecfd965b60d7aee2017e4d67da6764b8b1484fdcf4d492ac0c36f52e36e"} Jul 14 14:31:15.015306 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.015280 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:15.044127 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.044093 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ddd6b41-2874-4f0d-a168-4746db58dcd3-maas-api-service-ca\") pod \"9ddd6b41-2874-4f0d-a168-4746db58dcd3\" (UID: \"9ddd6b41-2874-4f0d-a168-4746db58dcd3\") " Jul 14 14:31:15.044501 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.044476 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ddd6b41-2874-4f0d-a168-4746db58dcd3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ddd6b41-2874-4f0d-a168-4746db58dcd3" (UID: "9ddd6b41-2874-4f0d-a168-4746db58dcd3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:31:15.145316 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.145223 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ddd6b41-2874-4f0d-a168-4746db58dcd3-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:31:15.876327 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.876298 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" Jul 14 14:31:15.876714 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.876338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8" event={"ID":"9ddd6b41-2874-4f0d-a168-4746db58dcd3","Type":"ContainerDied","Data":"80e83ea3926f427eba978bb9eac1d6d281ecf21f2070b1ef9073535bdb6ebf92"} Jul 14 14:31:15.876714 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:15.876385 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80e83ea3926f427eba978bb9eac1d6d281ecf21f2070b1ef9073535bdb6ebf92" Jul 14 14:31:38.966832 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.966796 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv"] Jul 14 14:31:38.967232 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.967219 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ddd6b41-2874-4f0d-a168-4746db58dcd3" containerName="revoke-keys" Jul 14 14:31:38.967232 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.967233 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ddd6b41-2874-4f0d-a168-4746db58dcd3" containerName="revoke-keys" Jul 14 14:31:38.967330 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.967321 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ddd6b41-2874-4f0d-a168-4746db58dcd3" containerName="revoke-keys" Jul 14 14:31:38.970614 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.970597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:38.973156 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.973134 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:31:38.978172 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:38.978149 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv"] Jul 14 14:31:39.058694 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:39.058664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083435ba-d845-490c-ac1d-dfc9ca045889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv\" (UID: \"083435ba-d845-490c-ac1d-dfc9ca045889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:39.159902 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:39.159872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083435ba-d845-490c-ac1d-dfc9ca045889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv\" (UID: \"083435ba-d845-490c-ac1d-dfc9ca045889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:39.160517 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:39.160500 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083435ba-d845-490c-ac1d-dfc9ca045889-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv\" (UID: \"083435ba-d845-490c-ac1d-dfc9ca045889\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:39.282342 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:39.282269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:39.432213 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:39.432168 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv"] Jul 14 14:31:39.437467 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:31:39.437437 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083435ba_d845_490c_ac1d_dfc9ca045889.slice/crio-a43c1acfc88f202ac74a7808ecb1076ca9a647bc754ad9f59b03443c15b5bc09 WatchSource:0}: Error finding container a43c1acfc88f202ac74a7808ecb1076ca9a647bc754ad9f59b03443c15b5bc09: Status 404 returned error can't find the container with id a43c1acfc88f202ac74a7808ecb1076ca9a647bc754ad9f59b03443c15b5bc09 Jul 14 14:31:40.006868 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:40.006771 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" event={"ID":"083435ba-d845-490c-ac1d-dfc9ca045889","Type":"ContainerStarted","Data":"3e3e8175c5f3c4d3170fe45aa7df57189f0154371aa50493dca76f542c78ef45"} Jul 14 14:31:40.006868 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:40.006832 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" event={"ID":"083435ba-d845-490c-ac1d-dfc9ca045889","Type":"ContainerStarted","Data":"a43c1acfc88f202ac74a7808ecb1076ca9a647bc754ad9f59b03443c15b5bc09"} Jul 14 14:31:40.024122 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:40.024078 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" podStartSLOduration=2.024062197 podStartE2EDuration="2.024062197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:40.021610317 +0000 UTC m=+2268.089709202" watchObservedRunningTime="2026-07-14 14:31:40.024062197 +0000 UTC m=+2268.092161052" Jul 14 14:31:41.014430 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:41.014391 2574 generic.go:356] "Generic (PLEG): container finished" podID="083435ba-d845-490c-ac1d-dfc9ca045889" containerID="3e3e8175c5f3c4d3170fe45aa7df57189f0154371aa50493dca76f542c78ef45" exitCode=0 Jul 14 14:31:41.014872 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:41.014478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" event={"ID":"083435ba-d845-490c-ac1d-dfc9ca045889","Type":"ContainerDied","Data":"3e3e8175c5f3c4d3170fe45aa7df57189f0154371aa50493dca76f542c78ef45"} Jul 14 14:31:42.165714 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:42.165690 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:42.289755 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:42.289670 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083435ba-d845-490c-ac1d-dfc9ca045889-maas-api-service-ca\") pod \"083435ba-d845-490c-ac1d-dfc9ca045889\" (UID: \"083435ba-d845-490c-ac1d-dfc9ca045889\") " Jul 14 14:31:42.290068 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:42.290042 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083435ba-d845-490c-ac1d-dfc9ca045889-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "083435ba-d845-490c-ac1d-dfc9ca045889" (UID: "083435ba-d845-490c-ac1d-dfc9ca045889"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:31:42.391337 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:42.391303 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083435ba-d845-490c-ac1d-dfc9ca045889-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:31:43.027496 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:43.027464 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" Jul 14 14:31:43.027701 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:43.027505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv" event={"ID":"083435ba-d845-490c-ac1d-dfc9ca045889","Type":"ContainerDied","Data":"a43c1acfc88f202ac74a7808ecb1076ca9a647bc754ad9f59b03443c15b5bc09"} Jul 14 14:31:43.027701 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:31:43.027578 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a43c1acfc88f202ac74a7808ecb1076ca9a647bc754ad9f59b03443c15b5bc09" Jul 14 14:32:31.576633 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.576593 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt"] Jul 14 14:32:31.577101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.577012 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="083435ba-d845-490c-ac1d-dfc9ca045889" containerName="revoke-keys" Jul 14 14:32:31.577101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.577023 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="083435ba-d845-490c-ac1d-dfc9ca045889" containerName="revoke-keys" Jul 14 14:32:31.577101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.577093 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="083435ba-d845-490c-ac1d-dfc9ca045889" containerName="revoke-keys" Jul 14 14:32:31.580170 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.580143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:31.582631 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.582615 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:32:31.588562 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.588537 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt"] Jul 14 14:32:31.722016 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.721979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/889a61de-f722-4afd-99f1-65554b4f44a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt\" (UID: \"889a61de-f722-4afd-99f1-65554b4f44a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:31.823145 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.823109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/889a61de-f722-4afd-99f1-65554b4f44a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt\" (UID: \"889a61de-f722-4afd-99f1-65554b4f44a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:31.823829 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.823809 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/889a61de-f722-4afd-99f1-65554b4f44a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt\" (UID: \"889a61de-f722-4afd-99f1-65554b4f44a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:31.891803 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:31.891725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:32.237059 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:32.237033 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt"] Jul 14 14:32:32.238807 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:32:32.238782 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889a61de_f722_4afd_99f1_65554b4f44a5.slice/crio-f53ab02a5306e841c7c52d0d9bde72b9a4ac348247543437dbd7343f830f7ec0 WatchSource:0}: Error finding container f53ab02a5306e841c7c52d0d9bde72b9a4ac348247543437dbd7343f830f7ec0: Status 404 returned error can't find the container with id f53ab02a5306e841c7c52d0d9bde72b9a4ac348247543437dbd7343f830f7ec0 Jul 14 14:32:32.289522 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:32.289494 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" event={"ID":"889a61de-f722-4afd-99f1-65554b4f44a5","Type":"ContainerStarted","Data":"f53ab02a5306e841c7c52d0d9bde72b9a4ac348247543437dbd7343f830f7ec0"} Jul 14 14:32:33.295751 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:33.295660 2574 generic.go:356] "Generic (PLEG): container finished" podID="889a61de-f722-4afd-99f1-65554b4f44a5" containerID="1a523aa24e7100325610d0f8ca311a334b109c250b24fa4f03e1a855858df652" exitCode=0 Jul 14 14:32:33.296104 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:33.295742 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" event={"ID":"889a61de-f722-4afd-99f1-65554b4f44a5","Type":"ContainerDied","Data":"1a523aa24e7100325610d0f8ca311a334b109c250b24fa4f03e1a855858df652"} Jul 14 14:32:34.443176 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:34.443151 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:34.547013 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:34.546984 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/889a61de-f722-4afd-99f1-65554b4f44a5-maas-api-service-ca\") pod \"889a61de-f722-4afd-99f1-65554b4f44a5\" (UID: \"889a61de-f722-4afd-99f1-65554b4f44a5\") " Jul 14 14:32:34.547364 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:34.547339 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/889a61de-f722-4afd-99f1-65554b4f44a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "889a61de-f722-4afd-99f1-65554b4f44a5" (UID: "889a61de-f722-4afd-99f1-65554b4f44a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:34.647813 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:34.647749 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/889a61de-f722-4afd-99f1-65554b4f44a5-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:32:35.307255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:35.307218 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" event={"ID":"889a61de-f722-4afd-99f1-65554b4f44a5","Type":"ContainerDied","Data":"f53ab02a5306e841c7c52d0d9bde72b9a4ac348247543437dbd7343f830f7ec0"} Jul 14 14:32:35.307255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:35.307241 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt" Jul 14 14:32:35.307464 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:35.307270 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f53ab02a5306e841c7c52d0d9bde72b9a4ac348247543437dbd7343f830f7ec0" Jul 14 14:32:57.886515 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.886479 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586"] Jul 14 14:32:57.886977 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.886932 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="889a61de-f722-4afd-99f1-65554b4f44a5" containerName="revoke-keys" Jul 14 14:32:57.886977 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.886945 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="889a61de-f722-4afd-99f1-65554b4f44a5" containerName="revoke-keys" Jul 14 14:32:57.887050 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.887010 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="889a61de-f722-4afd-99f1-65554b4f44a5" containerName="revoke-keys" Jul 14 14:32:57.890387 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.890368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:32:57.894665 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.894647 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:32:57.905831 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.905806 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586"] Jul 14 14:32:57.946877 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:57.946841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b8df26c-a418-4caf-862e-bfb9ce84ccc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9343ac-rk586\" (UID: \"3b8df26c-a418-4caf-862e-bfb9ce84ccc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:32:58.048424 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:58.048388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b8df26c-a418-4caf-862e-bfb9ce84ccc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9343ac-rk586\" (UID: \"3b8df26c-a418-4caf-862e-bfb9ce84ccc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:32:58.049039 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:58.049016 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b8df26c-a418-4caf-862e-bfb9ce84ccc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9343ac-rk586\" (UID: \"3b8df26c-a418-4caf-862e-bfb9ce84ccc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:32:58.200921 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:58.200883 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:32:58.346067 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:58.346040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586"] Jul 14 14:32:58.348002 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:32:58.347975 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8df26c_a418_4caf_862e_bfb9ce84ccc2.slice/crio-31155b64fc2eed6abd1ba8c5fe79f8aa211ffea5ca47a279020eb586f293730d WatchSource:0}: Error finding container 31155b64fc2eed6abd1ba8c5fe79f8aa211ffea5ca47a279020eb586f293730d: Status 404 returned error can't find the container with id 31155b64fc2eed6abd1ba8c5fe79f8aa211ffea5ca47a279020eb586f293730d Jul 14 14:32:58.431637 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:58.431603 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" event={"ID":"3b8df26c-a418-4caf-862e-bfb9ce84ccc2","Type":"ContainerStarted","Data":"31155b64fc2eed6abd1ba8c5fe79f8aa211ffea5ca47a279020eb586f293730d"} Jul 14 14:32:59.438667 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:59.438631 2574 generic.go:356] "Generic (PLEG): container finished" podID="3b8df26c-a418-4caf-862e-bfb9ce84ccc2" containerID="4176e6a4e846ca77cd7dfbb8c12ea1e2e16f9d034aac263c8f13eceaa446f6b0" exitCode=0 Jul 14 14:32:59.439048 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:32:59.438727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" event={"ID":"3b8df26c-a418-4caf-862e-bfb9ce84ccc2","Type":"ContainerDied","Data":"4176e6a4e846ca77cd7dfbb8c12ea1e2e16f9d034aac263c8f13eceaa446f6b0"} Jul 14 14:33:00.587862 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:00.587839 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:33:00.677439 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:00.677404 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b8df26c-a418-4caf-862e-bfb9ce84ccc2-maas-api-service-ca\") pod \"3b8df26c-a418-4caf-862e-bfb9ce84ccc2\" (UID: \"3b8df26c-a418-4caf-862e-bfb9ce84ccc2\") " Jul 14 14:33:00.677800 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:00.677775 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b8df26c-a418-4caf-862e-bfb9ce84ccc2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b8df26c-a418-4caf-862e-bfb9ce84ccc2" (UID: "3b8df26c-a418-4caf-862e-bfb9ce84ccc2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:00.778272 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:00.778172 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b8df26c-a418-4caf-862e-bfb9ce84ccc2-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:33:01.450946 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:01.450916 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" Jul 14 14:33:01.451131 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:01.450946 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9343ac-rk586" event={"ID":"3b8df26c-a418-4caf-862e-bfb9ce84ccc2","Type":"ContainerDied","Data":"31155b64fc2eed6abd1ba8c5fe79f8aa211ffea5ca47a279020eb586f293730d"} Jul 14 14:33:01.451131 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:01.451036 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31155b64fc2eed6abd1ba8c5fe79f8aa211ffea5ca47a279020eb586f293730d" Jul 14 14:33:52.614310 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:52.614278 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:33:52.616899 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:52.616879 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:33:52.622102 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:52.622081 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:33:52.627706 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:33:52.627686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:38:52.651863 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:38:52.651826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:38:52.656399 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:38:52.656371 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:38:52.660573 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:38:52.660551 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:38:52.664640 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:38:52.664621 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44t9t_ff6b1518-bfce-48d2-9d31-1caf6bbe1869/ovn-acl-logging/0.log" Jul 14 14:39:04.349845 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.349810 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7886-140528064759600"] Jul 14 14:39:04.350367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.350276 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8df26c-a418-4caf-862e-bfb9ce84ccc2" containerName="revoke-keys" Jul 14 14:39:04.350367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.350289 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8df26c-a418-4caf-862e-bfb9ce84ccc2" containerName="revoke-keys" Jul 14 14:39:04.350367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.350353 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b8df26c-a418-4caf-862e-bfb9ce84ccc2" containerName="revoke-keys" Jul 14 14:39:04.353405 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.353382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:04.355891 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.355873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-l7whp\"" Jul 14 14:39:04.365462 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.365434 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528064759600"] Jul 14 14:39:04.448989 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.448955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c99zr\" (UniqueName: \"kubernetes.io/projected/6abdbc25-f445-4d26-8073-f4671ec985b8-kube-api-access-c99zr\") pod \"test-curl-7886-140528064759600\" (UID: \"6abdbc25-f445-4d26-8073-f4671ec985b8\") " pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:04.549989 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.549949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c99zr\" (UniqueName: \"kubernetes.io/projected/6abdbc25-f445-4d26-8073-f4671ec985b8-kube-api-access-c99zr\") pod \"test-curl-7886-140528064759600\" (UID: \"6abdbc25-f445-4d26-8073-f4671ec985b8\") " pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:04.558473 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.558438 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c99zr\" (UniqueName: \"kubernetes.io/projected/6abdbc25-f445-4d26-8073-f4671ec985b8-kube-api-access-c99zr\") pod \"test-curl-7886-140528064759600\" (UID: \"6abdbc25-f445-4d26-8073-f4671ec985b8\") " pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:04.673347 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.673314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:04.813481 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.813447 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528064759600"] Jul 14 14:39:04.815379 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:04.815350 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6abdbc25_f445_4d26_8073_f4671ec985b8.slice/crio-434fcfb7630b78d29c5b04af55caf376adb199eb545374bd6e83ed40c979c244 WatchSource:0}: Error finding container 434fcfb7630b78d29c5b04af55caf376adb199eb545374bd6e83ed40c979c244: Status 404 returned error can't find the container with id 434fcfb7630b78d29c5b04af55caf376adb199eb545374bd6e83ed40c979c244 Jul 14 14:39:04.817025 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:04.817009 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:39:05.408124 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:05.408089 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528064759600" event={"ID":"6abdbc25-f445-4d26-8073-f4671ec985b8","Type":"ContainerStarted","Data":"434fcfb7630b78d29c5b04af55caf376adb199eb545374bd6e83ed40c979c244"} Jul 14 14:39:06.414997 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:06.414961 2574 generic.go:356] "Generic (PLEG): container finished" podID="6abdbc25-f445-4d26-8073-f4671ec985b8" containerID="ee47745d505c82b784e4ae2dfb1e64bf2729ef5cb38887128ea5b2afc547af55" exitCode=0 Jul 14 14:39:06.415378 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:06.415048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528064759600" event={"ID":"6abdbc25-f445-4d26-8073-f4671ec985b8","Type":"ContainerDied","Data":"ee47745d505c82b784e4ae2dfb1e64bf2729ef5cb38887128ea5b2afc547af55"} Jul 14 14:39:07.574529 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.574500 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:07.613137 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.613102 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7886-140528064759600_6abdbc25-f445-4d26-8073-f4671ec985b8/test-curl-7886-140528064759600/0.log" Jul 14 14:39:07.641574 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.641541 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7886-140528064759600"] Jul 14 14:39:07.645356 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.645332 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7886-140528064759600"] Jul 14 14:39:07.680954 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.680862 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c99zr\" (UniqueName: \"kubernetes.io/projected/6abdbc25-f445-4d26-8073-f4671ec985b8-kube-api-access-c99zr\") pod \"6abdbc25-f445-4d26-8073-f4671ec985b8\" (UID: \"6abdbc25-f445-4d26-8073-f4671ec985b8\") " Jul 14 14:39:07.682964 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.682941 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6abdbc25-f445-4d26-8073-f4671ec985b8-kube-api-access-c99zr" (OuterVolumeSpecName: "kube-api-access-c99zr") pod "6abdbc25-f445-4d26-8073-f4671ec985b8" (UID: "6abdbc25-f445-4d26-8073-f4671ec985b8"). InnerVolumeSpecName "kube-api-access-c99zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:39:07.781788 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.781752 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c99zr\" (UniqueName: \"kubernetes.io/projected/6abdbc25-f445-4d26-8073-f4671ec985b8-kube-api-access-c99zr\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:07.785192 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.785153 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7886-140528064760496"] Jul 14 14:39:07.785587 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.785575 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abdbc25-f445-4d26-8073-f4671ec985b8" containerName="test-curl-7886-140528064759600" Jul 14 14:39:07.785630 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.785589 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abdbc25-f445-4d26-8073-f4671ec985b8" containerName="test-curl-7886-140528064759600" Jul 14 14:39:07.785682 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.785672 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6abdbc25-f445-4d26-8073-f4671ec985b8" containerName="test-curl-7886-140528064759600" Jul 14 14:39:07.788923 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.788908 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:07.796304 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.796069 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528064760496"] Jul 14 14:39:07.882616 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.882586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tblv\" (UniqueName: \"kubernetes.io/projected/1bf01faf-1c6a-4e22-9436-18b698f22690-kube-api-access-8tblv\") pod \"test-curl-7886-140528064760496\" (UID: \"1bf01faf-1c6a-4e22-9436-18b698f22690\") " pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:07.983906 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.983815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tblv\" (UniqueName: \"kubernetes.io/projected/1bf01faf-1c6a-4e22-9436-18b698f22690-kube-api-access-8tblv\") pod \"test-curl-7886-140528064760496\" (UID: \"1bf01faf-1c6a-4e22-9436-18b698f22690\") " pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:07.991931 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:07.991899 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tblv\" (UniqueName: \"kubernetes.io/projected/1bf01faf-1c6a-4e22-9436-18b698f22690-kube-api-access-8tblv\") pod \"test-curl-7886-140528064760496\" (UID: \"1bf01faf-1c6a-4e22-9436-18b698f22690\") " pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:08.099308 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:08.099276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:08.236177 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:08.236151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528064760496"] Jul 14 14:39:08.237773 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:08.237734 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bf01faf_1c6a_4e22_9436_18b698f22690.slice/crio-29539729f3926ab5de3da806545ba81c8ae3582715929850fbd1dd0e02676921 WatchSource:0}: Error finding container 29539729f3926ab5de3da806545ba81c8ae3582715929850fbd1dd0e02676921: Status 404 returned error can't find the container with id 29539729f3926ab5de3da806545ba81c8ae3582715929850fbd1dd0e02676921 Jul 14 14:39:08.427553 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:08.427528 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:08.427745 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:08.427526 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="434fcfb7630b78d29c5b04af55caf376adb199eb545374bd6e83ed40c979c244" Jul 14 14:39:08.428671 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:08.428640 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528064760496" event={"ID":"1bf01faf-1c6a-4e22-9436-18b698f22690","Type":"ContainerStarted","Data":"29539729f3926ab5de3da806545ba81c8ae3582715929850fbd1dd0e02676921"} Jul 14 14:39:08.438512 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:39:08.438482 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7886-140528064759600\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="6abdbc25-f445-4d26-8073-f4671ec985b8" pod="openshift-ingress/test-curl-7886-140528064759600" Jul 14 14:39:08.488498 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:08.488407 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6abdbc25-f445-4d26-8073-f4671ec985b8" path="/var/lib/kubelet/pods/6abdbc25-f445-4d26-8073-f4671ec985b8/volumes" Jul 14 14:39:09.435542 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:09.435509 2574 generic.go:356] "Generic (PLEG): container finished" podID="1bf01faf-1c6a-4e22-9436-18b698f22690" containerID="05fa5538d3a22291fb007e5f6172bd7929b101d5bd974eaa4c5d4b06da980182" exitCode=0 Jul 14 14:39:09.435938 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:09.435602 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528064760496" event={"ID":"1bf01faf-1c6a-4e22-9436-18b698f22690","Type":"ContainerDied","Data":"05fa5538d3a22291fb007e5f6172bd7929b101d5bd974eaa4c5d4b06da980182"} Jul 14 14:39:10.592234 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.592209 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:10.614027 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.614008 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7886-140528064760496_1bf01faf-1c6a-4e22-9436-18b698f22690/test-curl-7886-140528064760496/0.log" Jul 14 14:39:10.639362 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.639337 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7886-140528064760496"] Jul 14 14:39:10.643173 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.643153 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7886-140528064760496"] Jul 14 14:39:10.708307 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.708246 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tblv\" (UniqueName: \"kubernetes.io/projected/1bf01faf-1c6a-4e22-9436-18b698f22690-kube-api-access-8tblv\") pod \"1bf01faf-1c6a-4e22-9436-18b698f22690\" (UID: \"1bf01faf-1c6a-4e22-9436-18b698f22690\") " Jul 14 14:39:10.710345 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.710324 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf01faf-1c6a-4e22-9436-18b698f22690-kube-api-access-8tblv" (OuterVolumeSpecName: "kube-api-access-8tblv") pod "1bf01faf-1c6a-4e22-9436-18b698f22690" (UID: "1bf01faf-1c6a-4e22-9436-18b698f22690"). InnerVolumeSpecName "kube-api-access-8tblv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:39:10.808836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.808810 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tblv\" (UniqueName: \"kubernetes.io/projected/1bf01faf-1c6a-4e22-9436-18b698f22690-kube-api-access-8tblv\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:10.810948 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.810927 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:10.811359 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.811345 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" containerName="test-curl-7886-140528064760496" Jul 14 14:39:10.811403 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.811361 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" containerName="test-curl-7886-140528064760496" Jul 14 14:39:10.811492 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.811438 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" containerName="test-curl-7886-140528064760496" Jul 14 14:39:10.814475 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.814460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:10.821622 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:10.821597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:11.011127 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.011041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsb2c\" (UniqueName: \"kubernetes.io/projected/131c7b02-b16b-4c68-b299-96507a72b440-kube-api-access-hsb2c\") pod \"test-curl-7886-140528066676896\" (UID: \"131c7b02-b16b-4c68-b299-96507a72b440\") " pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:11.111777 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.111744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb2c\" (UniqueName: \"kubernetes.io/projected/131c7b02-b16b-4c68-b299-96507a72b440-kube-api-access-hsb2c\") pod \"test-curl-7886-140528066676896\" (UID: \"131c7b02-b16b-4c68-b299-96507a72b440\") " pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:11.120695 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.120669 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsb2c\" (UniqueName: \"kubernetes.io/projected/131c7b02-b16b-4c68-b299-96507a72b440-kube-api-access-hsb2c\") pod \"test-curl-7886-140528066676896\" (UID: \"131c7b02-b16b-4c68-b299-96507a72b440\") " pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:11.123495 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.123473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:11.256374 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.256347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:11.258424 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:11.258392 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod131c7b02_b16b_4c68_b299_96507a72b440.slice/crio-4d6badf49c07c5a814d4535af019060cea3535b5c2b9c920b91985f359c04ccc WatchSource:0}: Error finding container 4d6badf49c07c5a814d4535af019060cea3535b5c2b9c920b91985f359c04ccc: Status 404 returned error can't find the container with id 4d6badf49c07c5a814d4535af019060cea3535b5c2b9c920b91985f359c04ccc Jul 14 14:39:11.447503 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.447474 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:11.447685 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.447519 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29539729f3926ab5de3da806545ba81c8ae3582715929850fbd1dd0e02676921" Jul 14 14:39:11.448704 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:11.448678 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528066676896" event={"ID":"131c7b02-b16b-4c68-b299-96507a72b440","Type":"ContainerStarted","Data":"4d6badf49c07c5a814d4535af019060cea3535b5c2b9c920b91985f359c04ccc"} Jul 14 14:39:11.458102 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:39:11.458069 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7886-140528064760496\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:12.456519 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:12.456484 2574 generic.go:356] "Generic (PLEG): container finished" podID="131c7b02-b16b-4c68-b299-96507a72b440" containerID="f92cdec5fe64819f179e4c44fd027f9151a6cad51f57cbe7b5a8e294e087147b" exitCode=0 Jul 14 14:39:12.456877 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:12.456528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528066676896" event={"ID":"131c7b02-b16b-4c68-b299-96507a72b440","Type":"ContainerDied","Data":"f92cdec5fe64819f179e4c44fd027f9151a6cad51f57cbe7b5a8e294e087147b"} Jul 14 14:39:12.458640 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:39:12.458617 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7886-140528064760496\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:12.485837 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:39:12.485805 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7886-140528064760496\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" pod="openshift-ingress/test-curl-7886-140528064760496" Jul 14 14:39:12.487272 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:12.487246 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bf01faf-1c6a-4e22-9436-18b698f22690" path="/var/lib/kubelet/pods/1bf01faf-1c6a-4e22-9436-18b698f22690/volumes" Jul 14 14:39:13.607174 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.607152 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:13.627929 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.627897 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7886-140528066676896_131c7b02-b16b-4c68-b299-96507a72b440/test-curl-7886-140528066676896/0.log" Jul 14 14:39:13.628134 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.628111 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsb2c\" (UniqueName: \"kubernetes.io/projected/131c7b02-b16b-4c68-b299-96507a72b440-kube-api-access-hsb2c\") pod \"131c7b02-b16b-4c68-b299-96507a72b440\" (UID: \"131c7b02-b16b-4c68-b299-96507a72b440\") " Jul 14 14:39:13.630165 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.630138 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131c7b02-b16b-4c68-b299-96507a72b440-kube-api-access-hsb2c" (OuterVolumeSpecName: "kube-api-access-hsb2c") pod "131c7b02-b16b-4c68-b299-96507a72b440" (UID: "131c7b02-b16b-4c68-b299-96507a72b440"). InnerVolumeSpecName "kube-api-access-hsb2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:39:13.654397 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.654373 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:13.658441 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.658417 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:13.728896 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.728825 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsb2c\" (UniqueName: \"kubernetes.io/projected/131c7b02-b16b-4c68-b299-96507a72b440-kube-api-access-hsb2c\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:13.783549 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.783516 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:13.783997 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.783980 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131c7b02-b16b-4c68-b299-96507a72b440" containerName="test-curl-7886-140528066676896" Jul 14 14:39:13.784095 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.784000 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="131c7b02-b16b-4c68-b299-96507a72b440" containerName="test-curl-7886-140528066676896" Jul 14 14:39:13.786997 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.784919 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="131c7b02-b16b-4c68-b299-96507a72b440" containerName="test-curl-7886-140528066676896" Jul 14 14:39:13.792352 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.792328 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:13.794482 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.794460 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:13.829924 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.829891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcldx\" (UniqueName: \"kubernetes.io/projected/dba486cc-c843-46db-83d1-1e11d3bfe999-kube-api-access-vcldx\") pod \"test-curl-7886-140528066676896\" (UID: \"dba486cc-c843-46db-83d1-1e11d3bfe999\") " pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:13.930580 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.930547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcldx\" (UniqueName: \"kubernetes.io/projected/dba486cc-c843-46db-83d1-1e11d3bfe999-kube-api-access-vcldx\") pod \"test-curl-7886-140528066676896\" (UID: \"dba486cc-c843-46db-83d1-1e11d3bfe999\") " pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:13.939991 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:13.939968 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcldx\" (UniqueName: \"kubernetes.io/projected/dba486cc-c843-46db-83d1-1e11d3bfe999-kube-api-access-vcldx\") pod \"test-curl-7886-140528066676896\" (UID: \"dba486cc-c843-46db-83d1-1e11d3bfe999\") " pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:14.103903 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.103814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:14.245802 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.245778 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:14.247556 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:14.247521 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddba486cc_c843_46db_83d1_1e11d3bfe999.slice/crio-a1154c28ed4efdee0b28c58ba32de7ad605df6da8616ec5da6eaebf3f7caa457 WatchSource:0}: Error finding container a1154c28ed4efdee0b28c58ba32de7ad605df6da8616ec5da6eaebf3f7caa457: Status 404 returned error can't find the container with id a1154c28ed4efdee0b28c58ba32de7ad605df6da8616ec5da6eaebf3f7caa457 Jul 14 14:39:14.468067 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.468030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528066676896" event={"ID":"dba486cc-c843-46db-83d1-1e11d3bfe999","Type":"ContainerStarted","Data":"a1154c28ed4efdee0b28c58ba32de7ad605df6da8616ec5da6eaebf3f7caa457"} Jul 14 14:39:14.469233 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.469212 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:14.469349 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.469221 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d6badf49c07c5a814d4535af019060cea3535b5c2b9c920b91985f359c04ccc" Jul 14 14:39:14.480955 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.480916 2574 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7886-140528066676896" oldPodUID="131c7b02-b16b-4c68-b299-96507a72b440" podUID="dba486cc-c843-46db-83d1-1e11d3bfe999" Jul 14 14:39:14.486890 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:14.486868 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="131c7b02-b16b-4c68-b299-96507a72b440" path="/var/lib/kubelet/pods/131c7b02-b16b-4c68-b299-96507a72b440/volumes" Jul 14 14:39:15.477267 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:15.477233 2574 generic.go:356] "Generic (PLEG): container finished" podID="dba486cc-c843-46db-83d1-1e11d3bfe999" containerID="95aab9f460974b0a9619eb8b66de40b00b06376191408f7d1b43dd42cb83312d" exitCode=0 Jul 14 14:39:15.477652 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:15.477296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528066676896" event={"ID":"dba486cc-c843-46db-83d1-1e11d3bfe999","Type":"ContainerDied","Data":"95aab9f460974b0a9619eb8b66de40b00b06376191408f7d1b43dd42cb83312d"} Jul 14 14:39:16.625866 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.625839 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:16.646835 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.646815 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7886-140528066676896_dba486cc-c843-46db-83d1-1e11d3bfe999/test-curl-7886-140528066676896/0.log" Jul 14 14:39:16.651550 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.651531 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcldx\" (UniqueName: \"kubernetes.io/projected/dba486cc-c843-46db-83d1-1e11d3bfe999-kube-api-access-vcldx\") pod \"dba486cc-c843-46db-83d1-1e11d3bfe999\" (UID: \"dba486cc-c843-46db-83d1-1e11d3bfe999\") " Jul 14 14:39:16.653523 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.653495 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba486cc-c843-46db-83d1-1e11d3bfe999-kube-api-access-vcldx" (OuterVolumeSpecName: "kube-api-access-vcldx") pod "dba486cc-c843-46db-83d1-1e11d3bfe999" (UID: "dba486cc-c843-46db-83d1-1e11d3bfe999"). InnerVolumeSpecName "kube-api-access-vcldx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:39:16.672280 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.672260 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:16.677981 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.677958 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7886-140528066676896"] Jul 14 14:39:16.752660 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.752603 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcldx\" (UniqueName: \"kubernetes.io/projected/dba486cc-c843-46db-83d1-1e11d3bfe999-kube-api-access-vcldx\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:16.806886 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.806859 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:16.807277 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.807256 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba486cc-c843-46db-83d1-1e11d3bfe999" containerName="test-curl-7886-140528066676896" Jul 14 14:39:16.807277 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.807271 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba486cc-c843-46db-83d1-1e11d3bfe999" containerName="test-curl-7886-140528066676896" Jul 14 14:39:16.807411 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.807355 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dba486cc-c843-46db-83d1-1e11d3bfe999" containerName="test-curl-7886-140528066676896" Jul 14 14:39:16.810424 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.810408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:16.814491 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.814473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:16.853120 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.853098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6psrt\" (UniqueName: \"kubernetes.io/projected/28e753dd-3579-4790-84e2-f7af46f249a3-kube-api-access-6psrt\") pod \"test-curl-7886-140528068748608\" (UID: \"28e753dd-3579-4790-84e2-f7af46f249a3\") " pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:16.954140 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.954106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6psrt\" (UniqueName: \"kubernetes.io/projected/28e753dd-3579-4790-84e2-f7af46f249a3-kube-api-access-6psrt\") pod \"test-curl-7886-140528068748608\" (UID: \"28e753dd-3579-4790-84e2-f7af46f249a3\") " pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:16.962862 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:16.962833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6psrt\" (UniqueName: \"kubernetes.io/projected/28e753dd-3579-4790-84e2-f7af46f249a3-kube-api-access-6psrt\") pod \"test-curl-7886-140528068748608\" (UID: \"28e753dd-3579-4790-84e2-f7af46f249a3\") " pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:17.119888 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:17.119807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:17.259008 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:17.258981 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:17.260767 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:17.260739 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28e753dd_3579_4790_84e2_f7af46f249a3.slice/crio-052afd21d9a07985e9d1451e6326acdb26a753a46217621e4a460e417012dc85 WatchSource:0}: Error finding container 052afd21d9a07985e9d1451e6326acdb26a753a46217621e4a460e417012dc85: Status 404 returned error can't find the container with id 052afd21d9a07985e9d1451e6326acdb26a753a46217621e4a460e417012dc85 Jul 14 14:39:17.490208 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:17.490158 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:17.490376 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:17.490211 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1154c28ed4efdee0b28c58ba32de7ad605df6da8616ec5da6eaebf3f7caa457" Jul 14 14:39:17.491709 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:17.491677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528068748608" event={"ID":"28e753dd-3579-4790-84e2-f7af46f249a3","Type":"ContainerStarted","Data":"052afd21d9a07985e9d1451e6326acdb26a753a46217621e4a460e417012dc85"} Jul 14 14:39:17.500814 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:39:17.500785 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7886-140528066676896\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="dba486cc-c843-46db-83d1-1e11d3bfe999" pod="openshift-ingress/test-curl-7886-140528066676896" Jul 14 14:39:18.488290 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:18.488249 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dba486cc-c843-46db-83d1-1e11d3bfe999" path="/var/lib/kubelet/pods/dba486cc-c843-46db-83d1-1e11d3bfe999/volumes" Jul 14 14:39:18.498303 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:18.498276 2574 generic.go:356] "Generic (PLEG): container finished" podID="28e753dd-3579-4790-84e2-f7af46f249a3" containerID="0adb7ebb0611c14ba2de5ec3c357a48d781d4bab06585782d7dedbb4aaeb2440" exitCode=0 Jul 14 14:39:18.498418 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:18.498336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528068748608" event={"ID":"28e753dd-3579-4790-84e2-f7af46f249a3","Type":"ContainerDied","Data":"0adb7ebb0611c14ba2de5ec3c357a48d781d4bab06585782d7dedbb4aaeb2440"} Jul 14 14:39:19.651433 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.651400 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:19.674559 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.674523 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6psrt\" (UniqueName: \"kubernetes.io/projected/28e753dd-3579-4790-84e2-f7af46f249a3-kube-api-access-6psrt\") pod \"28e753dd-3579-4790-84e2-f7af46f249a3\" (UID: \"28e753dd-3579-4790-84e2-f7af46f249a3\") " Jul 14 14:39:19.675667 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.675643 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7886-140528068748608_28e753dd-3579-4790-84e2-f7af46f249a3/test-curl-7886-140528068748608/0.log" Jul 14 14:39:19.676766 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.676745 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e753dd-3579-4790-84e2-f7af46f249a3-kube-api-access-6psrt" (OuterVolumeSpecName: "kube-api-access-6psrt") pod "28e753dd-3579-4790-84e2-f7af46f249a3" (UID: "28e753dd-3579-4790-84e2-f7af46f249a3"). InnerVolumeSpecName "kube-api-access-6psrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:39:19.703101 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.703076 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:19.708593 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.708574 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:19.775255 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.775179 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6psrt\" (UniqueName: \"kubernetes.io/projected/28e753dd-3579-4790-84e2-f7af46f249a3-kube-api-access-6psrt\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:19.844912 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.844888 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:19.845367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.845352 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e753dd-3579-4790-84e2-f7af46f249a3" containerName="test-curl-7886-140528068748608" Jul 14 14:39:19.845367 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.845368 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e753dd-3579-4790-84e2-f7af46f249a3" containerName="test-curl-7886-140528068748608" Jul 14 14:39:19.845468 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.845456 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e753dd-3579-4790-84e2-f7af46f249a3" containerName="test-curl-7886-140528068748608" Jul 14 14:39:19.848494 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.848478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:19.853203 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.853162 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:19.875953 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.875929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62kk\" (UniqueName: \"kubernetes.io/projected/e6e54139-fc32-4830-95f8-f036bf4f670e-kube-api-access-z62kk\") pod \"test-curl-7886-140528068748608\" (UID: \"e6e54139-fc32-4830-95f8-f036bf4f670e\") " pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:19.976608 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.976572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62kk\" (UniqueName: \"kubernetes.io/projected/e6e54139-fc32-4830-95f8-f036bf4f670e-kube-api-access-z62kk\") pod \"test-curl-7886-140528068748608\" (UID: \"e6e54139-fc32-4830-95f8-f036bf4f670e\") " pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:19.984982 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:19.984957 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62kk\" (UniqueName: \"kubernetes.io/projected/e6e54139-fc32-4830-95f8-f036bf4f670e-kube-api-access-z62kk\") pod \"test-curl-7886-140528068748608\" (UID: \"e6e54139-fc32-4830-95f8-f036bf4f670e\") " pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:20.160047 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:20.160015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:20.295248 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:20.295221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:20.297171 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:20.297144 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6e54139_fc32_4830_95f8_f036bf4f670e.slice/crio-e6c91c96659a22600bf7ed53bba979dceeed02b3225747751ea1591f6f28fe13 WatchSource:0}: Error finding container e6c91c96659a22600bf7ed53bba979dceeed02b3225747751ea1591f6f28fe13: Status 404 returned error can't find the container with id e6c91c96659a22600bf7ed53bba979dceeed02b3225747751ea1591f6f28fe13 Jul 14 14:39:20.487241 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:20.487156 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e753dd-3579-4790-84e2-f7af46f249a3" path="/var/lib/kubelet/pods/28e753dd-3579-4790-84e2-f7af46f249a3/volumes" Jul 14 14:39:20.511403 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:20.511375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528068748608" event={"ID":"e6e54139-fc32-4830-95f8-f036bf4f670e","Type":"ContainerStarted","Data":"e6c91c96659a22600bf7ed53bba979dceeed02b3225747751ea1591f6f28fe13"} Jul 14 14:39:20.512537 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:20.512521 2574 scope.go:117] "RemoveContainer" containerID="0adb7ebb0611c14ba2de5ec3c357a48d781d4bab06585782d7dedbb4aaeb2440" Jul 14 14:39:20.512614 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:20.512539 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:21.520312 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:21.520275 2574 generic.go:356] "Generic (PLEG): container finished" podID="e6e54139-fc32-4830-95f8-f036bf4f670e" containerID="0b35b47c3f9fcffdfca84b4b4f00427bbc4ee88942f9a96597184f7adb812d43" exitCode=0 Jul 14 14:39:21.520737 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:21.520365 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7886-140528068748608" event={"ID":"e6e54139-fc32-4830-95f8-f036bf4f670e","Type":"ContainerDied","Data":"0b35b47c3f9fcffdfca84b4b4f00427bbc4ee88942f9a96597184f7adb812d43"} Jul 14 14:39:22.681156 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.681127 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:22.697822 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.697792 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z62kk\" (UniqueName: \"kubernetes.io/projected/e6e54139-fc32-4830-95f8-f036bf4f670e-kube-api-access-z62kk\") pod \"e6e54139-fc32-4830-95f8-f036bf4f670e\" (UID: \"e6e54139-fc32-4830-95f8-f036bf4f670e\") " Jul 14 14:39:22.701084 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.700602 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e54139-fc32-4830-95f8-f036bf4f670e-kube-api-access-z62kk" (OuterVolumeSpecName: "kube-api-access-z62kk") pod "e6e54139-fc32-4830-95f8-f036bf4f670e" (UID: "e6e54139-fc32-4830-95f8-f036bf4f670e"). InnerVolumeSpecName "kube-api-access-z62kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:39:22.703333 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.703212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7886-140528068748608_e6e54139-fc32-4830-95f8-f036bf4f670e/test-curl-7886-140528068748608/0.log" Jul 14 14:39:22.730418 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.730380 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:22.734082 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.734058 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7886-140528068748608"] Jul 14 14:39:22.799073 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.798974 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z62kk\" (UniqueName: \"kubernetes.io/projected/e6e54139-fc32-4830-95f8-f036bf4f670e-kube-api-access-z62kk\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:22.919201 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.919144 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv"] Jul 14 14:39:22.919685 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.919665 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e54139-fc32-4830-95f8-f036bf4f670e" containerName="test-curl-7886-140528068748608" Jul 14 14:39:22.919781 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.919687 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e54139-fc32-4830-95f8-f036bf4f670e" containerName="test-curl-7886-140528068748608" Jul 14 14:39:22.919836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.919793 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e54139-fc32-4830-95f8-f036bf4f670e" containerName="test-curl-7886-140528068748608" Jul 14 14:39:22.922936 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.922913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:22.925470 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.925450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:39:22.929852 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:22.929828 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv"] Jul 14 14:39:23.008278 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.008239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cceb760-c7d0-4400-a8b5-5baf613d7dcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv\" (UID: \"8cceb760-c7d0-4400-a8b5-5baf613d7dcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:23.108855 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.108752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cceb760-c7d0-4400-a8b5-5baf613d7dcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv\" (UID: \"8cceb760-c7d0-4400-a8b5-5baf613d7dcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:23.109501 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.109481 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cceb760-c7d0-4400-a8b5-5baf613d7dcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv\" (UID: \"8cceb760-c7d0-4400-a8b5-5baf613d7dcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:23.236742 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.236710 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:23.379231 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.379200 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv"] Jul 14 14:39:23.381161 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:23.381107 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cceb760_c7d0_4400_a8b5_5baf613d7dcd.slice/crio-6c37253afc44a68127e315ba2ac7b33f8235123462dd724010732aa90b658284 WatchSource:0}: Error finding container 6c37253afc44a68127e315ba2ac7b33f8235123462dd724010732aa90b658284: Status 404 returned error can't find the container with id 6c37253afc44a68127e315ba2ac7b33f8235123462dd724010732aa90b658284 Jul 14 14:39:23.533045 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.533005 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" event={"ID":"8cceb760-c7d0-4400-a8b5-5baf613d7dcd","Type":"ContainerStarted","Data":"6c37253afc44a68127e315ba2ac7b33f8235123462dd724010732aa90b658284"} Jul 14 14:39:23.534284 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.534261 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6c91c96659a22600bf7ed53bba979dceeed02b3225747751ea1591f6f28fe13" Jul 14 14:39:23.534428 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:23.534316 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:23.544898 ip-10-0-128-255 kubenswrapper[2574]: E0714 14:39:23.544867 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7886-140528068748608\" is forbidden: User \"system:node:ip-10-0-128-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-255.ec2.internal' and this object" podUID="e6e54139-fc32-4830-95f8-f036bf4f670e" pod="openshift-ingress/test-curl-7886-140528068748608" Jul 14 14:39:24.488426 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:24.488388 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e54139-fc32-4830-95f8-f036bf4f670e" path="/var/lib/kubelet/pods/e6e54139-fc32-4830-95f8-f036bf4f670e/volumes" Jul 14 14:39:24.540869 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:24.540840 2574 generic.go:356] "Generic (PLEG): container finished" podID="8cceb760-c7d0-4400-a8b5-5baf613d7dcd" containerID="b3f2954cdaa1e6ad04bdec37f3c068c9fc181701b343eba0c8d33f3ab0ef921e" exitCode=0 Jul 14 14:39:24.541034 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:24.540928 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" event={"ID":"8cceb760-c7d0-4400-a8b5-5baf613d7dcd","Type":"ContainerDied","Data":"b3f2954cdaa1e6ad04bdec37f3c068c9fc181701b343eba0c8d33f3ab0ef921e"} Jul 14 14:39:25.698928 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:25.698903 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:25.730818 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:25.730791 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cceb760-c7d0-4400-a8b5-5baf613d7dcd-maas-api-service-ca\") pod \"8cceb760-c7d0-4400-a8b5-5baf613d7dcd\" (UID: \"8cceb760-c7d0-4400-a8b5-5baf613d7dcd\") " Jul 14 14:39:25.731138 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:25.731118 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cceb760-c7d0-4400-a8b5-5baf613d7dcd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8cceb760-c7d0-4400-a8b5-5baf613d7dcd" (UID: "8cceb760-c7d0-4400-a8b5-5baf613d7dcd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:39:25.832092 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:25.832004 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cceb760-c7d0-4400-a8b5-5baf613d7dcd-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:26.553787 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:26.553760 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" Jul 14 14:39:26.553960 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:26.553800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv" event={"ID":"8cceb760-c7d0-4400-a8b5-5baf613d7dcd","Type":"ContainerDied","Data":"6c37253afc44a68127e315ba2ac7b33f8235123462dd724010732aa90b658284"} Jul 14 14:39:26.553960 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:26.553844 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c37253afc44a68127e315ba2ac7b33f8235123462dd724010732aa90b658284" Jul 14 14:39:49.266948 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.266908 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd"] Jul 14 14:39:49.267581 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.267337 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cceb760-c7d0-4400-a8b5-5baf613d7dcd" containerName="revoke-keys" Jul 14 14:39:49.267581 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.267349 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cceb760-c7d0-4400-a8b5-5baf613d7dcd" containerName="revoke-keys" Jul 14 14:39:49.267581 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.267431 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cceb760-c7d0-4400-a8b5-5baf613d7dcd" containerName="revoke-keys" Jul 14 14:39:49.270787 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.270762 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:49.274250 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.274229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nk9bs\"" Jul 14 14:39:49.285683 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.285657 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd"] Jul 14 14:39:49.341104 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.341067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3eda205-1261-408f-9d09-7c8e252c4e08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd\" (UID: \"e3eda205-1261-408f-9d09-7c8e252c4e08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:49.441808 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.441767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3eda205-1261-408f-9d09-7c8e252c4e08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd\" (UID: \"e3eda205-1261-408f-9d09-7c8e252c4e08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:49.442452 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.442430 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3eda205-1261-408f-9d09-7c8e252c4e08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd\" (UID: \"e3eda205-1261-408f-9d09-7c8e252c4e08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:49.581232 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.581123 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:49.928838 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:49.928812 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd"] Jul 14 14:39:49.930696 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:39:49.930664 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3eda205_1261_408f_9d09_7c8e252c4e08.slice/crio-ecf98219a7af0ca61e6bca498f9e2f04fb9d231cb68c25e848be667c200c00bb WatchSource:0}: Error finding container ecf98219a7af0ca61e6bca498f9e2f04fb9d231cb68c25e848be667c200c00bb: Status 404 returned error can't find the container with id ecf98219a7af0ca61e6bca498f9e2f04fb9d231cb68c25e848be667c200c00bb Jul 14 14:39:50.696511 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:50.696469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" event={"ID":"e3eda205-1261-408f-9d09-7c8e252c4e08","Type":"ContainerStarted","Data":"8b39b0b1902e147a5f9fd7e4e3496ff544f0b57fd5b09bc3df72b951e3958e70"} Jul 14 14:39:50.696860 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:50.696533 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" event={"ID":"e3eda205-1261-408f-9d09-7c8e252c4e08","Type":"ContainerStarted","Data":"ecf98219a7af0ca61e6bca498f9e2f04fb9d231cb68c25e848be667c200c00bb"} Jul 14 14:39:50.714706 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:50.714663 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" podStartSLOduration=1.714649603 podStartE2EDuration="1.714649603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:39:50.712625632 +0000 UTC m=+2758.780724500" watchObservedRunningTime="2026-07-14 14:39:50.714649603 +0000 UTC m=+2758.782748505" Jul 14 14:39:51.703120 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:51.703083 2574 generic.go:356] "Generic (PLEG): container finished" podID="e3eda205-1261-408f-9d09-7c8e252c4e08" containerID="8b39b0b1902e147a5f9fd7e4e3496ff544f0b57fd5b09bc3df72b951e3958e70" exitCode=0 Jul 14 14:39:51.703528 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:51.703163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" event={"ID":"e3eda205-1261-408f-9d09-7c8e252c4e08","Type":"ContainerDied","Data":"8b39b0b1902e147a5f9fd7e4e3496ff544f0b57fd5b09bc3df72b951e3958e70"} Jul 14 14:39:52.850065 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:52.850033 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:52.976458 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:52.976377 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3eda205-1261-408f-9d09-7c8e252c4e08-maas-api-service-ca\") pod \"e3eda205-1261-408f-9d09-7c8e252c4e08\" (UID: \"e3eda205-1261-408f-9d09-7c8e252c4e08\") " Jul 14 14:39:52.976806 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:52.976781 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3eda205-1261-408f-9d09-7c8e252c4e08-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e3eda205-1261-408f-9d09-7c8e252c4e08" (UID: "e3eda205-1261-408f-9d09-7c8e252c4e08"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:39:53.077145 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:53.077107 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3eda205-1261-408f-9d09-7c8e252c4e08-maas-api-service-ca\") on node \"ip-10-0-128-255.ec2.internal\" DevicePath \"\"" Jul 14 14:39:53.715335 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:53.715307 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" Jul 14 14:39:53.715510 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:53.715345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd" event={"ID":"e3eda205-1261-408f-9d09-7c8e252c4e08","Type":"ContainerDied","Data":"ecf98219a7af0ca61e6bca498f9e2f04fb9d231cb68c25e848be667c200c00bb"} Jul 14 14:39:53.715510 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:39:53.715392 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecf98219a7af0ca61e6bca498f9e2f04fb9d231cb68c25e848be667c200c00bb" Jul 14 14:40:21.701147 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:21.701078 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g2dj9_eceaf50f-5d6b-47f3-a34c-37ad444f4cc1/manager/0.log" Jul 14 14:40:21.978116 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:21.978023 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bdf659b57-9hlf9_6dd261a6-305a-4166-9448-a0f4cb5f9a25/manager/0.log" Jul 14 14:40:22.282696 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:22.282622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dxmgk_2ab715ec-4da7-4acc-9adb-c5bb77981429/manager/0.log" Jul 14 14:40:22.418127 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:22.418099 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f858c8968-5c2ng_f63c20cf-3ade-4ba8-95b6-8344ae5d900a/copy-manifests/0.log" Jul 14 14:40:22.425221 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:22.425178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f858c8968-5c2ng_f63c20cf-3ade-4ba8-95b6-8344ae5d900a/manager/0.log" Jul 14 14:40:23.121981 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:23.121954 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d88856d7b-cgb99_14ba9495-1b0a-4569-a2ed-5be6e254543d/maas-api/0.log" Jul 14 14:40:23.643073 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:23.643042 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-6f52b160-cn5bp_28b0ce3b-17dc-4be5-8683-5628f2374720/revoke-keys/0.log" Jul 14 14:40:23.771119 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:23.771090 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-a7298c-7f8mt_889a61de-f722-4afd-99f1-65554b4f44a5/revoke-keys/0.log" Jul 14 14:40:23.903645 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:23.903575 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-9343ac-rk586_3b8df26c-a418-4caf-862e-bfb9ce84ccc2/revoke-keys/0.log" Jul 14 14:40:24.028288 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:24.028257 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-9cad56cb-gcdw9_d4f09319-7308-456c-b3e6-294105cd3c21/revoke-keys/0.log" Jul 14 14:40:24.155468 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:24.155449 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-0bd8ad-qdcs8_9ddd6b41-2874-4f0d-a168-4746db58dcd3/revoke-keys/0.log" Jul 14 14:40:24.285710 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:24.285685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-94a6fc-p8rdv_083435ba-d845-490c-ac1d-dfc9ca045889/revoke-keys/0.log" Jul 14 14:40:24.548550 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:24.548467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-32d459c1-rq5j9_e907ff3f-2f3b-4108-947a-de624308cc7e/revoke-keys/0.log" Jul 14 14:40:24.804204 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:24.804120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-8442f2-2bxkv_8cceb760-c7d0-4400-a8b5-5baf613d7dcd/revoke-keys/0.log" Jul 14 14:40:24.934618 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:24.934592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-f8f81e-2xwzd_e3eda205-1261-408f-9d09-7c8e252c4e08/revoke-keys/0.log" Jul 14 14:40:25.063623 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:25.063554 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zsqpd_91069b9f-98e3-4378-b4d2-d5d407670367/postgres/0.log" Jul 14 14:40:26.685684 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:26.685657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2gqtq_0ad97bb3-9af1-4b2b-8891-bcd672751dfb/manager/0.log" Jul 14 14:40:26.816003 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:26.815975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xmpr7_408e2bda-64c1-497f-be5c-034440bab509/manager/0.log" Jul 14 14:40:27.079632 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:27.079555 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vlmh5_158086bd-2e57-4893-afda-2b558ae144e5/registry-server/0.log" Jul 14 14:40:27.233955 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:27.233918 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hdm5r_701da5ab-4814-4911-8caf-84452fcd2033/manager/0.log" Jul 14 14:40:27.525561 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:27.525528 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n87h7_ba5567f7-9818-4c93-b260-318566027658/manager/0.log" Jul 14 14:40:28.195416 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:28.195388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64945c8566-r56vc_cc4010aa-4657-471f-98e2-ceccfaeb0cb1/kube-auth-proxy/0.log" Jul 14 14:40:28.584970 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:28.584887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-njlb9_a81e564e-dce5-425f-b198-2984331d6ff3/payload-pre-processing/0.log" Jul 14 14:40:28.845085 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:28.844983 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6b64644-bzmkz_baabe0fd-609f-4826-b7df-f08652ac60ab/router/0.log" Jul 14 14:40:29.355692 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:29.355650 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x7m8r_b8100ced-171b-4430-8f8f-4ce728d28e3f/main/0.log" Jul 14 14:40:29.487617 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:29.487574 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7prx7_f0987301-2f15-4a2e-b059-d95e40a8f761/main/0.log" Jul 14 14:40:29.757056 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:29.757019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wx5hq_beaedf62-1915-4798-b925-e85be9a8fb15/main/0.log" Jul 14 14:40:37.240449 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:37.240424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4c9nv_a1b6fb18-b4c3-4f89-b300-668bedc1d7ee/global-pull-secret-syncer/0.log" Jul 14 14:40:37.460366 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:37.460335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cwhkl_566a70ee-bc1e-464d-a28d-24f051cbb7ae/konnectivity-agent/0.log" Jul 14 14:40:37.511412 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:37.511331 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-255.ec2.internal_c78769e0bb1c929f58ca5348a71d49d6/haproxy/0.log" Jul 14 14:40:42.014993 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:42.014962 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2gqtq_0ad97bb3-9af1-4b2b-8891-bcd672751dfb/manager/0.log" Jul 14 14:40:42.066682 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:42.066651 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xmpr7_408e2bda-64c1-497f-be5c-034440bab509/manager/0.log" Jul 14 14:40:42.137875 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:42.137847 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vlmh5_158086bd-2e57-4893-afda-2b558ae144e5/registry-server/0.log" Jul 14 14:40:42.268647 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:42.268563 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hdm5r_701da5ab-4814-4911-8caf-84452fcd2033/manager/0.log" Jul 14 14:40:42.377541 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:42.377503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n87h7_ba5567f7-9818-4c93-b260-318566027658/manager/0.log" Jul 14 14:40:44.361384 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:44.361349 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-bcmrf_bc1ba704-85c2-4ed5-80f2-ed62c9f02272/cluster-monitoring-operator/0.log" Jul 14 14:40:44.539818 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:44.539792 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sjvq_c94a869f-1cba-48f1-841f-e696f48c731c/node-exporter/0.log" Jul 14 14:40:44.565795 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:44.565772 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sjvq_c94a869f-1cba-48f1-841f-e696f48c731c/kube-rbac-proxy/0.log" Jul 14 14:40:44.594275 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:44.594250 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sjvq_c94a869f-1cba-48f1-841f-e696f48c731c/init-textfile/0.log" Jul 14 14:40:45.241867 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:45.241838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-jcxsn_613841a8-2fe6-48bf-a7fd-0fb0722b6a25/prometheus-operator-admission-webhook/0.log" Jul 14 14:40:46.807836 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:46.807806 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-25l5p_5b18e5b0-77ab-486e-9250-07a2dd24cdb7/networking-console-plugin/0.log" Jul 14 14:40:47.550133 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.550093 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/1.log" Jul 14 14:40:47.555970 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.555947 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gv99t_366945c0-3ffb-4b1d-9b27-0947917bf6d7/console-operator/2.log" Jul 14 14:40:47.630965 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.630931 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx"] Jul 14 14:40:47.631370 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.631357 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3eda205-1261-408f-9d09-7c8e252c4e08" containerName="revoke-keys" Jul 14 14:40:47.631420 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.631372 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3eda205-1261-408f-9d09-7c8e252c4e08" containerName="revoke-keys" Jul 14 14:40:47.631468 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.631459 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3eda205-1261-408f-9d09-7c8e252c4e08" containerName="revoke-keys" Jul 14 14:40:47.634704 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.634684 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.637359 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.637338 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flfn5\"/\"default-dockercfg-6s2zw\"" Jul 14 14:40:47.637462 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.637341 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flfn5\"/\"openshift-service-ca.crt\"" Jul 14 14:40:47.638314 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.638293 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flfn5\"/\"kube-root-ca.crt\"" Jul 14 14:40:47.646177 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.646154 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx"] Jul 14 14:40:47.753281 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.753247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-proc\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.753281 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.753286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-podres\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.753494 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.753305 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-sys\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.753494 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.753329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvfn\" (UniqueName: \"kubernetes.io/projected/61867515-599b-4818-9818-6dee4373652b-kube-api-access-fmvfn\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.753494 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.753366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-lib-modules\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854346 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-proc\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854346 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-podres\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854346 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-sys\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854346 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvfn\" (UniqueName: \"kubernetes.io/projected/61867515-599b-4818-9818-6dee4373652b-kube-api-access-fmvfn\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854814 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-lib-modules\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854814 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854392 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-proc\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854814 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854402 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-sys\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854814 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854437 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-podres\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.854814 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.854502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61867515-599b-4818-9818-6dee4373652b-lib-modules\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.863554 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.863533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvfn\" (UniqueName: \"kubernetes.io/projected/61867515-599b-4818-9818-6dee4373652b-kube-api-access-fmvfn\") pod \"perf-node-gather-daemonset-jxjpx\" (UID: \"61867515-599b-4818-9818-6dee4373652b\") " pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:47.944589 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:47.944551 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:48.088214 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:48.088157 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx"] Jul 14 14:40:48.089432 ip-10-0-128-255 kubenswrapper[2574]: W0714 14:40:48.089402 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61867515_599b_4818_9818_6dee4373652b.slice/crio-3297362b58fe19f7ae03886d58d7f602805c442f16a72d56475bd54a1f10f908 WatchSource:0}: Error finding container 3297362b58fe19f7ae03886d58d7f602805c442f16a72d56475bd54a1f10f908: Status 404 returned error can't find the container with id 3297362b58fe19f7ae03886d58d7f602805c442f16a72d56475bd54a1f10f908 Jul 14 14:40:48.268011 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:48.267983 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-544dd75647-46zln_ba7e9265-66f7-4e18-abb9-a8f72c77d298/console/0.log" Jul 14 14:40:48.307344 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:48.307312 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-4nfqb_6a72e177-558e-439c-a509-1dac34de6b34/download-server/0.log" Jul 14 14:40:48.980322 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:48.980293 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-2sgth_8c1b1ab5-8f44-487f-9769-abe4242c7622/volume-data-source-validator/0.log" Jul 14 14:40:49.030798 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:49.030764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" event={"ID":"61867515-599b-4818-9818-6dee4373652b","Type":"ContainerStarted","Data":"721eed34b42e386081ceea8e166eebfde5f42bb901de1bbb2d26e01d02d60841"} Jul 14 14:40:49.030968 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:49.030936 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:49.030968 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:49.030961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" event={"ID":"61867515-599b-4818-9818-6dee4373652b","Type":"ContainerStarted","Data":"3297362b58fe19f7ae03886d58d7f602805c442f16a72d56475bd54a1f10f908"} Jul 14 14:40:50.347431 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:50.347401 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qr87g_4e2f38ab-d834-4650-abf5-d0ca199c0da4/dns/0.log" Jul 14 14:40:50.375961 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:50.375927 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qr87g_4e2f38ab-d834-4650-abf5-d0ca199c0da4/kube-rbac-proxy/0.log" Jul 14 14:40:50.408955 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:50.408926 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ffkp_19746321-8c32-49e7-8574-c1d3bb66276f/dns-node-resolver/0.log" Jul 14 14:40:51.082666 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:51.082633 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6247h_e61db8eb-06c6-4f98-a037-d431374d297b/node-ca/0.log" Jul 14 14:40:52.239937 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:52.239905 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64945c8566-r56vc_cc4010aa-4657-471f-98e2-ceccfaeb0cb1/kube-auth-proxy/0.log" Jul 14 14:40:52.361392 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:52.361363 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-njlb9_a81e564e-dce5-425f-b198-2984331d6ff3/payload-pre-processing/0.log" Jul 14 14:40:52.421152 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:52.421121 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6b64644-bzmkz_baabe0fd-609f-4826-b7df-f08652ac60ab/router/0.log" Jul 14 14:40:53.180315 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:53.180283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wpqwk_e2ed97dc-eae1-4d05-9f84-96324bdf52eb/serve-healthcheck-canary/0.log" Jul 14 14:40:53.683301 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:53.683273 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-l9htw_3b3aa349-a588-4e4c-978b-0c5b0aa27216/insights-operator/0.log" Jul 14 14:40:53.683950 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:53.683937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-l9htw_3b3aa349-a588-4e4c-978b-0c5b0aa27216/insights-operator/1.log" Jul 14 14:40:53.851347 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:53.851318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xpsp2_f6bd7139-4dd7-4d55-9dd5-eed2201ce179/kube-rbac-proxy/0.log" Jul 14 14:40:53.872523 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:53.872496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xpsp2_f6bd7139-4dd7-4d55-9dd5-eed2201ce179/exporter/0.log" Jul 14 14:40:53.894031 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:53.894006 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xpsp2_f6bd7139-4dd7-4d55-9dd5-eed2201ce179/extractor/0.log" Jul 14 14:40:55.047064 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:55.047040 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" Jul 14 14:40:55.066966 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:55.066910 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flfn5/perf-node-gather-daemonset-jxjpx" podStartSLOduration=8.06689417 podStartE2EDuration="8.06689417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:40:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:40:49.047094393 +0000 UTC m=+2817.115193249" watchObservedRunningTime="2026-07-14 14:40:55.06689417 +0000 UTC m=+2823.134993034" Jul 14 14:40:56.137624 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:56.137593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g2dj9_eceaf50f-5d6b-47f3-a34c-37ad444f4cc1/manager/0.log" Jul 14 14:40:56.482310 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:56.482284 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bdf659b57-9hlf9_6dd261a6-305a-4166-9448-a0f4cb5f9a25/manager/0.log" Jul 14 14:40:56.563586 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:56.563557 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dxmgk_2ab715ec-4da7-4acc-9adb-c5bb77981429/manager/0.log" Jul 14 14:40:56.590667 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:56.590646 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f858c8968-5c2ng_f63c20cf-3ade-4ba8-95b6-8344ae5d900a/manager/0.log" Jul 14 14:40:56.612922 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:56.612903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f858c8968-5c2ng_f63c20cf-3ade-4ba8-95b6-8344ae5d900a/copy-manifests/0.log" Jul 14 14:40:58.540040 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:58.540007 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64945c8566-r56vc_cc4010aa-4657-471f-98e2-ceccfaeb0cb1/kube-auth-proxy/0.log" Jul 14 14:40:58.624455 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:58.624424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-njlb9_a81e564e-dce5-425f-b198-2984331d6ff3/payload-pre-processing/0.log" Jul 14 14:40:58.663846 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:40:58.663821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6b64644-bzmkz_baabe0fd-609f-4826-b7df-f08652ac60ab/router/0.log" Jul 14 14:41:00.078571 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:00.078486 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64945c8566-r56vc_cc4010aa-4657-471f-98e2-ceccfaeb0cb1/kube-auth-proxy/0.log" Jul 14 14:41:00.193575 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:00.193544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-njlb9_a81e564e-dce5-425f-b198-2984331d6ff3/payload-pre-processing/0.log" Jul 14 14:41:00.232455 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:00.232428 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86c6b64644-bzmkz_baabe0fd-609f-4826-b7df-f08652ac60ab/router/0.log" Jul 14 14:41:03.550785 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:03.550754 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkjjh_622e7f31-fa21-47e3-9738-eed3c168bd84/migrator/0.log" Jul 14 14:41:03.576137 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:03.576108 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkjjh_622e7f31-fa21-47e3-9738-eed3c168bd84/graceful-termination/0.log" Jul 14 14:41:03.974643 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:03.974613 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-cnd8q_df04271c-2cc2-4129-a11c-76d256b11939/kube-storage-version-migrator-operator/1.log" Jul 14 14:41:03.975513 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:03.975488 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-cnd8q_df04271c-2cc2-4129-a11c-76d256b11939/kube-storage-version-migrator-operator/0.log" Jul 14 14:41:05.139436 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:05.139407 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5hbmn_c8b669d0-882d-4d49-8c63-c3cc1f064b54/kube-multus/0.log" Jul 14 14:41:05.375292 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:05.375264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khhn7_31b08467-f3ee-431a-843f-46949d3ea475/kube-multus-additional-cni-plugins/0.log" Jul 14 14:41:05.417783 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:05.417760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khhn7_31b08467-f3ee-431a-843f-46949d3ea475/egress-router-binary-copy/0.log" Jul 14 14:41:05.462557 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:05.462532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khhn7_31b08467-f3ee-431a-843f-46949d3ea475/cni-plugins/0.log" Jul 14 14:41:05.506779 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:05.506756 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khhn7_31b08467-f3ee-431a-843f-46949d3ea475/bond-cni-plugin/0.log" Jul 14 14:41:05.552615 ip-10-0-128-255 kubenswrapper[2574]: I0714 14:41:05.552591 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khhn7_31b08467-f3ee-431a-843f-46949d3ea475/routeoverride-cni/0.log"