Jul 07 02:14:57.374733 ip-10-0-133-186 systemd[1]: Starting Kubernetes Kubelet... Jul 07 02:14:57.761841 ip-10-0-133-186 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 02:14:57.761841 ip-10-0-133-186 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 02:14:57.761841 ip-10-0-133-186 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 02:14:57.761841 ip-10-0-133-186 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 02:14:57.761841 ip-10-0-133-186 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 02:14:57.764134 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.764037 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 02:14:57.768579 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768561 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:14:57.768579 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768579 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768582 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768586 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768590 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768593 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768595 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768598 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768601 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768603 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768606 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768609 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768612 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768619 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768622 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768624 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768627 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768629 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768632 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768634 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768637 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768639 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:14:57.768654 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768642 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768644 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768648 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768652 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768654 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768657 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768660 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768663 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768666 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768668 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768671 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768673 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768676 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768678 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768682 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768686 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768690 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768693 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768696 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:14:57.769150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768699 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768701 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768704 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768706 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768709 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768711 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768714 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768716 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768719 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768722 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768724 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768727 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768729 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768732 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768735 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768738 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768740 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768743 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768745 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:14:57.769620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768748 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768750 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768753 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768755 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768757 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768760 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768762 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768764 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768767 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768769 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768772 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768775 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768777 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768780 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768783 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768785 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768787 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768789 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768793 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768795 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:14:57.770130 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768798 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768800 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768803 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768805 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768808 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768810 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768813 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768816 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768819 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768822 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768824 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768827 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768829 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768832 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768834 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768838 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768841 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768844 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:14:57.770643 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.768847 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:14:57.771428 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771415 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:14:57.771428 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771428 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771433 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771436 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771439 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771445 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771448 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771451 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771453 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771456 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771458 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771461 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771463 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771466 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771468 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771470 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771473 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771475 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771478 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771480 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:14:57.771491 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771482 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771485 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771487 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771490 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771492 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771494 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771497 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771501 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771503 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771506 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771508 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771511 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771513 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771515 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771519 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771523 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771525 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771528 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771531 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771534 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:14:57.771962 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771537 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771539 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771542 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771545 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771547 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771549 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771552 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771555 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771559 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771562 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771564 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771567 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771569 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771571 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771575 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771578 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771580 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771583 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771585 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771588 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:14:57.772480 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771590 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771592 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771595 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771597 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771600 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771603 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771605 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771608 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771610 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771613 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771615 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771618 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771621 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771623 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771626 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771628 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771631 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771633 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771636 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771638 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:14:57.772958 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771641 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771643 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771645 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771648 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771651 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771653 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771656 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771658 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771661 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771663 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771665 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771668 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771670 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771672 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771675 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771677 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771679 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771682 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.771684 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772068 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:14:57.773457 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772072 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772075 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772078 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772081 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772084 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772086 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772089 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772091 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772094 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772096 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772098 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772101 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772103 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772106 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772108 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772111 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772114 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772117 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772120 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772122 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:14:57.773953 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772125 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772127 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772130 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772132 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772135 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772137 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772139 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772142 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772144 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772147 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772149 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772151 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772154 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772157 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772159 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772161 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772164 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772167 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772169 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772172 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:14:57.774462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772174 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772176 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772179 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772181 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772185 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772188 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772190 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772194 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772197 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772200 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772202 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772204 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772207 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772209 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772212 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772214 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772217 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772219 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772223 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:14:57.774946 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772226 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772229 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772232 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772234 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772236 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772239 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772241 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772243 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772246 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772248 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772251 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772254 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772256 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772259 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772262 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772264 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772267 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772269 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772271 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772274 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772277 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:14:57.775462 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772279 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772282 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772284 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772287 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772290 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772292 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772295 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772298 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772300 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772303 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772306 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772309 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772312 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772315 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772320 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772323 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772325 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.772327 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772425 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772436 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 02:14:57.775957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772443 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772448 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772453 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772456 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772460 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772464 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772467 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772470 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772473 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772477 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772480 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772483 2556 flags.go:64] FLAG: --cgroup-root="" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772486 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772489 2556 flags.go:64] FLAG: --client-ca-file="" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772493 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772497 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772506 2556 flags.go:64] FLAG: --cluster-domain="" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772508 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772511 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772514 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772518 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772522 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772525 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 02:14:57.776468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772527 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772531 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772533 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772539 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772541 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772544 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772547 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772551 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772554 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772557 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772560 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772563 2556 flags.go:64] FLAG: --enable-server="true" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772566 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772571 2556 flags.go:64] FLAG: --event-burst="100" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772574 2556 flags.go:64] FLAG: --event-qps="50" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772576 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772579 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772582 2556 flags.go:64] FLAG: --eviction-hard="" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772586 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772589 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772592 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772595 2556 flags.go:64] FLAG: --eviction-soft="" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772598 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772600 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772603 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 02:14:57.777010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772606 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772609 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772611 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772614 2556 flags.go:64] FLAG: --feature-gates="" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772618 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772621 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772624 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772627 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772629 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772632 2556 flags.go:64] FLAG: --help="false" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772636 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-186.ec2.internal" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772640 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772643 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772645 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772649 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772652 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772655 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772658 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772660 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772663 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772666 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772669 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772672 2556 flags.go:64] FLAG: --kube-reserved="" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772675 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 02:14:57.777635 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772677 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772680 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772683 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772685 2556 flags.go:64] FLAG: --lock-file="" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772688 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772691 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772694 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772699 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772701 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772704 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772707 2556 flags.go:64] FLAG: --logging-format="text" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772709 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772712 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772715 2556 flags.go:64] FLAG: --manifest-url="" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772717 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772722 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772724 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772728 2556 flags.go:64] FLAG: --max-pods="110" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772733 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772736 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772738 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772741 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772744 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772747 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772750 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 02:14:57.778212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772760 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772763 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772766 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772768 2556 flags.go:64] FLAG: --pod-cidr="" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772772 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772778 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772781 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772784 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772787 2556 flags.go:64] FLAG: --port="10250" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772790 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772793 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d4edc7d0f0de8e5" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772796 2556 flags.go:64] FLAG: --qos-reserved="" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772799 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772801 2556 flags.go:64] FLAG: --register-node="true" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772804 2556 flags.go:64] FLAG: --register-with-taints="" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772807 2556 flags.go:64] FLAG: --registry-burst="10" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772810 2556 flags.go:64] FLAG: --registry-qps="5" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772813 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772815 2556 flags.go:64] FLAG: --reserved-memory="" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772819 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772822 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772825 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772828 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772830 2556 flags.go:64] FLAG: --runonce="false" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772833 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 02:14:57.778864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772837 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772840 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772842 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772845 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772848 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772853 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772855 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772858 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772861 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772864 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772866 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772869 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772873 2556 flags.go:64] FLAG: --system-cgroups="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772876 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772881 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772884 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772887 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772891 2556 flags.go:64] FLAG: --tls-min-version="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772894 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772896 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772899 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772902 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772905 2556 flags.go:64] FLAG: --v="2" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772909 2556 flags.go:64] FLAG: --version="false" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772913 2556 flags.go:64] FLAG: --vmodule="" Jul 07 02:14:57.779528 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772916 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.772920 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773042 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773046 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773049 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773052 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773055 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773059 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773061 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773064 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773067 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773069 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773073 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773076 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773078 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773081 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773083 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773086 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773088 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773091 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:14:57.780140 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773094 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773096 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773099 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773101 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773103 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773106 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773108 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773111 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773113 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773115 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773118 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773122 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773125 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773128 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773130 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773133 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773136 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773139 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773141 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:14:57.780750 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773145 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773147 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773150 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773152 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773154 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773159 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773163 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773165 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773168 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773171 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773174 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773176 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773179 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773182 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773185 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773189 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773192 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773195 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773198 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:14:57.781290 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773200 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773202 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773205 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773207 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773210 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773212 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773214 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773217 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773220 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773222 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773225 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773227 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773230 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773233 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773236 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773238 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773241 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773243 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773246 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:14:57.781771 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773249 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773251 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773254 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773256 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773259 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773262 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773264 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773267 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773269 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773272 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773275 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773277 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773279 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773282 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773285 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773287 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773289 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773292 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773294 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773296 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:14:57.782242 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773298 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773301 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773303 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.773306 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.773818 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.781206 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.781223 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.781247 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.781252 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781323 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781328 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781332 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781335 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781338 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781341 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:14:57.782737 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781344 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781347 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781349 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781352 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781355 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781357 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781360 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781363 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781366 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781368 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781371 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781373 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781376 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781378 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781394 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781398 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781401 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781403 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781406 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781409 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:14:57.783110 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781411 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781415 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781417 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781421 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781424 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781427 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781429 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781432 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781435 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781437 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781440 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781444 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781448 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781451 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781453 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781456 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781458 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781462 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:14:57.783620 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781466 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781469 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781472 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781475 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781478 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781480 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781483 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781485 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781488 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781490 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781493 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781495 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781498 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781500 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781503 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781506 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781509 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781512 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781515 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781518 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:14:57.784050 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781520 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781523 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781525 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781528 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781530 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781533 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781535 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781539 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781542 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781545 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781548 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781550 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781553 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781555 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781557 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781560 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781562 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781565 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781567 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:14:57.784601 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781570 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781572 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781575 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781577 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781580 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781582 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781584 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781587 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781589 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781592 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781595 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781597 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781600 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781603 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781605 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:14:57.785059 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781608 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.781613 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781747 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781752 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781754 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781757 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781760 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781763 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781766 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781768 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781771 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781774 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781776 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781779 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781782 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:14:57.785551 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781784 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781787 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781790 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781792 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781794 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781797 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781799 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781802 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781804 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781806 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781809 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781812 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781814 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781817 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781819 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781822 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781824 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781827 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781829 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:14:57.785914 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781832 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781834 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781836 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781839 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781841 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781844 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781846 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781849 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781851 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781853 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781856 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781860 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781863 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781866 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781869 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781871 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781874 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781877 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781879 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:14:57.786360 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781882 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781886 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781890 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781892 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781895 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781898 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781901 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781903 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781906 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781908 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781911 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781916 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781919 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781922 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781925 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781928 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781930 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781933 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781935 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781938 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:14:57.786813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781941 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781943 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781946 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781948 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781950 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781953 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781955 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781958 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781961 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781963 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781966 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781968 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781970 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781973 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781975 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781978 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781981 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781983 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781986 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:14:57.787287 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781988 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781990 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781993 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781995 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.781998 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.782001 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.782003 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.782006 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:14:57.782008 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.782013 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.782148 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.785107 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.786599 2556 server.go:1019] "Starting client certificate rotation" Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.786702 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 02:14:57.787778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.786738 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 02:14:57.791099 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.791075 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 02:14:57.792431 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.792410 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 02:14:57.802900 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.802879 2556 log.go:25] "Validated CRI v1 runtime API" Jul 07 02:14:57.806226 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.806211 2556 log.go:25] "Validated CRI v1 image API" Jul 07 02:14:57.808569 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.808548 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 02:14:57.811919 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.811896 2556 fs.go:135] Filesystem UUIDs: map[2f99e6b5-e5f6-4d83-a99f-ee47bb6dee26:/dev/nvme0n1p4 57a4bc2b-c6d2-4baa-8868-a965ebe9acc7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 02:14:57.811973 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.811920 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 02:14:57.817277 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.817257 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 02:14:57.818419 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.818287 2556 manager.go:216] Machine: {Timestamp:2026-07-07 02:14:57.816447327 +0000 UTC m=+0.325723690 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101630 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2115007b50b52ddbc7adaff875cbc4 SystemUUID:ec211500-7b50-b52d-dbc7-adaff875cbc4 BootID:3723a024-10b3-433b-a858-0f454ad5d6b3 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8f:59:e8:7e:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8f:59:e8:7e:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:ee:1c:cf:2e:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 02:14:57.818419 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.818416 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 02:14:57.818530 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.818509 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 02:14:57.821257 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.821230 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 02:14:57.821430 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.821262 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 02:14:57.822336 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.822326 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 02:14:57.822371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.822338 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 02:14:57.822371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.822346 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 02:14:57.822993 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.822982 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 02:14:57.824202 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.824191 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 02:14:57.826956 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.826944 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 07 02:14:57.827070 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827062 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 02:14:57.827109 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827090 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 07 02:14:57.827109 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827101 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 02:14:57.827162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827116 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 02:14:57.827162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827125 2556 kubelet.go:398] "Adding apiserver pod source" Jul 07 02:14:57.827162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827134 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 02:14:57.827523 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827511 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 02:14:57.827580 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.827529 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 02:14:57.830630 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.830567 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 02:14:57.832447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.832429 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 02:14:57.832523 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.832462 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 02:14:57.833498 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833486 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833505 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833514 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833521 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833530 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833538 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833549 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 02:14:57.833555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833556 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 02:14:57.833733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833566 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 02:14:57.833733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833572 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 02:14:57.833733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833584 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 02:14:57.833733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.833589 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 02:14:57.834412 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.834403 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 02:14:57.834412 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.834413 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 02:14:57.837811 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.837797 2556 server.go:1268] "Started kubelet" Jul 07 02:14:57.837910 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.837882 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 02:14:57.838037 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.837999 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 02:14:57.838099 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.838067 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 02:14:57.838956 ip-10-0-133-186 systemd[1]: Started Kubernetes Kubelet. Jul 07 02:14:57.839217 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.839195 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 02:14:57.839318 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.839202 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 02:14:57.839318 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.839284 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 02:14:57.839895 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.839831 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 02:14:57.840692 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.840678 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 07 02:14:57.844083 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.844063 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 02:14:57.844579 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.843619 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-186.ec2.internal.18bfe0357f6d494f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-186.ec2.internal,UID:ip-10-0-133-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-186.ec2.internal,},FirstTimestamp:2026-07-07 02:14:57.837762895 +0000 UTC m=+0.347039258,LastTimestamp:2026-07-07 02:14:57.837762895 +0000 UTC m=+0.347039258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-186.ec2.internal,}" Jul 07 02:14:57.845324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.845305 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hcphv" Jul 07 02:14:57.845405 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.845370 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 02:14:57.845468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.845414 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 02:14:57.845611 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.845595 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:57.846082 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846066 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 02:14:57.846199 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846077 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 02:14:57.846199 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846200 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 02:14:57.846352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846178 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 02:14:57.846352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846273 2556 factory.go:55] Registering systemd factory Jul 07 02:14:57.846352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846286 2556 factory.go:223] Registration of the systemd container factory successfully Jul 07 02:14:57.846352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846321 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 07 02:14:57.846352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846330 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 07 02:14:57.846552 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846529 2556 factory.go:153] Registering CRI-O factory Jul 07 02:14:57.846589 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846558 2556 factory.go:223] Registration of the crio container factory successfully Jul 07 02:14:57.846589 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846578 2556 factory.go:103] Registering Raw factory Jul 07 02:14:57.846589 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846587 2556 manager.go:1196] Started watching for new ooms in manager Jul 07 02:14:57.847046 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.846989 2556 manager.go:349] Starting recovery of all containers Jul 07 02:14:57.851132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.851086 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hcphv" Jul 07 02:14:57.851490 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.851465 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 02:14:57.851755 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.851722 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 02:14:57.859202 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.859027 2556 manager.go:354] Recovery completed Jul 07 02:14:57.863909 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.863895 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:57.865724 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.865706 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:57.865768 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.865739 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:57.865768 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.865750 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:57.866304 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.866289 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 02:14:57.866367 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.866304 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 02:14:57.866367 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.866322 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 07 02:14:57.866367 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.866337 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:57.867013 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.866998 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:57.867055 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.867027 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:57.867055 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.867040 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:57.867636 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.867623 2556 policy_none.go:49] "None policy: Start" Jul 07 02:14:57.867695 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.867643 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 02:14:57.867695 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.867657 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 02:14:57.868633 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.868622 2556 policy_none.go:47] "Start" Jul 07 02:14:57.905020 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905001 2556 manager.go:337] "Starting Device Plugin manager" Jul 07 02:14:57.905155 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.905044 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 02:14:57.905155 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905055 2556 server.go:87] "Starting device plugin registration server" Jul 07 02:14:57.905311 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905300 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 02:14:57.905354 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905312 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 02:14:57.905492 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905470 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 02:14:57.905588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905563 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 02:14:57.905588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:57.905578 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 02:14:57.906149 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.906131 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 02:14:57.906218 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:57.906190 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:58.005854 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.005811 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:58.007086 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.007002 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:58.007086 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.007035 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:58.007086 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.007045 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:58.007210 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.007112 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.015571 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.015526 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.015571 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:58.015554 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-186.ec2.internal\": node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:58.019870 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.019838 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 02:14:58.021211 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.021190 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 02:14:58.021313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.021229 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 02:14:58.021313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.021248 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 02:14:58.021313 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:58.021278 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 02:14:58.023821 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.023796 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:14:58.034004 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:58.033979 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:58.122276 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.122240 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal"] Jul 07 02:14:58.122471 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.122343 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:58.124118 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.124094 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:58.124199 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.124124 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:58.124199 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.124133 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:58.125475 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.125461 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:58.125606 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.125592 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.125666 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.125630 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:58.126237 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.126220 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:58.126237 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.126232 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:58.126369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.126254 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:58.126369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.126266 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:58.126369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.126266 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:58.126369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.126331 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:58.127591 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.127575 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.127697 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.127598 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:14:58.128510 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.128492 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:14:58.128590 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.128522 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:14:58.128590 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.128539 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:14:58.135049 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:58.135028 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:58.146047 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:58.146019 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-186.ec2.internal\" not found" node="ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.147306 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.147283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb8b9783df7fd776c87f7b113a061f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"58eb8b9783df7fd776c87f7b113a061f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.147410 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.147314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb8b9783df7fd776c87f7b113a061f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"58eb8b9783df7fd776c87f7b113a061f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.147410 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:58.147331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce2cf4076b6f479baf250b405f7ccd8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-186.ec2.internal\" (UID: \"2ce2cf4076b6f479baf250b405f7ccd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" Jul 07 02:14:58.149994 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:58.149977 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-186.ec2.internal\" not found" node="ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.250217 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.250174 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.262485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.262463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb8b9783df7fd776c87f7b113a061f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"58eb8b9783df7fd776c87f7b113a061f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.262582 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.262494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb8b9783df7fd776c87f7b113a061f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"58eb8b9783df7fd776c87f7b113a061f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.262582 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.262516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce2cf4076b6f479baf250b405f7ccd8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-186.ec2.internal\" (UID: \"2ce2cf4076b6f479baf250b405f7ccd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.262668 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.262574 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58eb8b9783df7fd776c87f7b113a061f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"58eb8b9783df7fd776c87f7b113a061f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.262668 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.262649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb8b9783df7fd776c87f7b113a061f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal\" (UID: \"58eb8b9783df7fd776c87f7b113a061f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.262668 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.262623 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce2cf4076b6f479baf250b405f7ccd8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-186.ec2.internal\" (UID: \"2ce2cf4076b6f479baf250b405f7ccd8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.350977 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.350915 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.451500 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.451476 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.463842 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.463805 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.467685 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.467457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" Jul 07 02:14:59.552253 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.552212 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.652904 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.652824 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.753401 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.753365 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.800030 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.799997 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 02:14:59.800612 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.800169 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 02:14:59.854528 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.854489 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:14:59.867630 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.867597 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 02:09:58 +0000 UTC" deadline="2028-03-16 08:24:47.044284142 +0000 UTC" Jul 07 02:14:59.867630 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:14:59.867625 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14838h9m47.176662375s" Jul 07 02:14:59.955613 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:14:59.955585 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:15:00.023384 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:00.023346 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58eb8b9783df7fd776c87f7b113a061f.slice/crio-61ba3f698c13ac8b63466a05ed55f3c18fcba9c0f7972ca81e19c48ae260f72f WatchSource:0}: Error finding container 61ba3f698c13ac8b63466a05ed55f3c18fcba9c0f7972ca81e19c48ae260f72f: Status 404 returned error can't find the container with id 61ba3f698c13ac8b63466a05ed55f3c18fcba9c0f7972ca81e19c48ae260f72f Jul 07 02:15:00.023842 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:00.023819 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce2cf4076b6f479baf250b405f7ccd8.slice/crio-328a9c15d8880b4b3f50f0f14959c7243a5a85e061839ac9ce2816b0f8eebf53 WatchSource:0}: Error finding container 328a9c15d8880b4b3f50f0f14959c7243a5a85e061839ac9ce2816b0f8eebf53: Status 404 returned error can't find the container with id 328a9c15d8880b4b3f50f0f14959c7243a5a85e061839ac9ce2816b0f8eebf53 Jul 07 02:15:00.028122 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.028104 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:15:00.039362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.039297 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" event={"ID":"58eb8b9783df7fd776c87f7b113a061f","Type":"ContainerStarted","Data":"61ba3f698c13ac8b63466a05ed55f3c18fcba9c0f7972ca81e19c48ae260f72f"} Jul 07 02:15:00.040267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.040246 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" event={"ID":"2ce2cf4076b6f479baf250b405f7ccd8","Type":"ContainerStarted","Data":"328a9c15d8880b4b3f50f0f14959c7243a5a85e061839ac9ce2816b0f8eebf53"} Jul 07 02:15:00.056460 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.056421 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:15:00.156977 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.156945 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-186.ec2.internal\" not found" Jul 07 02:15:00.160870 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.160853 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:15:00.260826 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.260747 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" Jul 07 02:15:00.271464 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.271443 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 02:15:00.273805 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.273789 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" Jul 07 02:15:00.281092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.281073 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 02:15:00.351704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.351672 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:15:00.375710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.375677 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:15:00.842449 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.842414 2556 apiserver.go:52] "Watching apiserver" Jul 07 02:15:00.847251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.847220 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 02:15:00.847828 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.847795 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-848sh","openshift-network-diagnostics/network-check-target-bcqjb","openshift-network-operator/iptables-alerter-jsvbf","kube-system/global-pull-secret-syncer-qtjbj","openshift-cluster-node-tuning-operator/tuned-cnc7g","openshift-image-registry/node-ca-hk8cw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal","openshift-multus/multus-gxzvt","openshift-multus/network-metrics-daemon-w2kkp","openshift-ovn-kubernetes/ovnkube-node-cvqzg","kube-system/konnectivity-agent-9nxr8","kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp","openshift-dns/node-resolver-cdthv"] Jul 07 02:15:00.850507 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.849768 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.850990 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.850970 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.853163 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.852050 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 02:15:00.853163 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.852403 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 02:15:00.853163 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.852695 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.853163 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.852735 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.853413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.853192 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 02:15:00.853413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.853238 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 02:15:00.853518 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.853489 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.853658 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.853618 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fzwqs\"" Jul 07 02:15:00.853759 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.853629 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xgdcl\"" Jul 07 02:15:00.854138 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.854120 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.854426 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.854408 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 02:15:00.854672 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.854656 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.854893 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.854876 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.855085 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.855066 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rs549\"" Jul 07 02:15:00.855180 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.855162 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.855393 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.855376 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 02:15:00.855462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.855409 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.855519 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.855497 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:00.855912 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.855722 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.857526 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.857507 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.858100 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.857836 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hx45g\"" Jul 07 02:15:00.858100 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.857897 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.858532 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.858509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.860346 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.860318 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.862329 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.860616 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.862416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.860769 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c466h\"" Jul 07 02:15:00.862726 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.861401 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 02:15:00.862804 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.862127 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 02:15:00.863102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.863085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:00.863294 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.863270 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:00.864730 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.864710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:00.866748 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.866718 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.867171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.867129 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tbvrc\"" Jul 07 02:15:00.867351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.867332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.867351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.867348 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:00.867498 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.867465 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:00.868620 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.868598 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.870743 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.870723 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:00.872415 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872390 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:00.872501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3b765d1-889d-4154-9f56-408bd962bbd4-host\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.872501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-slash\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.872501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-run-netns\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.872656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-cni-bin\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.872656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn28n\" (UniqueName: \"kubernetes.io/projected/82fde3a3-524c-46f5-9057-526594cff32b-kube-api-access-rn28n\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.872656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-etc-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.872656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.872656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bce55014-ddb8-4cd4-9652-b44f92053d6f-kubelet-config\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.872656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwr8q\" (UniqueName: \"kubernetes.io/projected/f3b765d1-889d-4154-9f56-408bd962bbd4-kube-api-access-cwr8q\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.872927 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.872658 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.873589 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.873335 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 02:15:00.873589 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.873427 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 02:15:00.873589 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.873427 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 02:15:00.873799 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.873730 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smf7v\"" Jul 07 02:15:00.873943 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.873923 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 02:15:00.874075 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874057 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 02:15:00.874191 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874174 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 02:15:00.874280 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-kubelet\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.874352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.874409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-iptables-alerter-script\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.874460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-modprobe-d\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.874460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874434 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l6hwm\"" Jul 07 02:15:00.874555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874440 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-systemd\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.874611 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-ovnkube-config\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.874689 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-sys\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.874742 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-lib-modules\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.874742 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-var-lib-kubelet\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.874839 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-tuned\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.874839 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-tmp\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.874987 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs2qj\" (UniqueName: \"kubernetes.io/projected/e6ba5b83-9449-46d8-b751-d001dc7bd041-kube-api-access-vs2qj\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:00.874987 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-registration-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.874987 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qxqg\" (UniqueName: \"kubernetes.io/projected/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-kube-api-access-5qxqg\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.874987 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-ovnkube-script-lib\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.875161 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.874983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxh2b\" (UniqueName: \"kubernetes.io/projected/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-kube-api-access-wxh2b\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.875161 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875033 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-host\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875161 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875079 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-device-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.875161 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82fde3a3-524c-46f5-9057-526594cff32b-ovn-node-metrics-cert\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.875352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-kubernetes\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysctl-conf\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5tbc\" (UniqueName: \"kubernetes.io/projected/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-kube-api-access-q5tbc\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-sys-fs\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.875488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bce55014-ddb8-4cd4-9652-b44f92053d6f-dbus\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.875488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875438 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.875488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3b765d1-889d-4154-9f56-408bd962bbd4-serviceca\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.875706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-systemd-units\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.875706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875550 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-host-slash\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.875706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysctl-d\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875621 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-run\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.875706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-socket-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875722 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875728 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875771 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fjzxh\"" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-var-lib-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-log-socket\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-systemd\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.875994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.876351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.875981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-ovn\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.876351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.876065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-node-log\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.876351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.876120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-cni-netd\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.876351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.876152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-env-overrides\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.876351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.876188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysconfig\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.882788 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.881683 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 02:15:00.900607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.900584 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wlpt7" Jul 07 02:15:00.906033 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.906008 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wlpt7" Jul 07 02:15:00.961645 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.961601 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 02:15:00.976344 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs2qj\" (UniqueName: \"kubernetes.io/projected/e6ba5b83-9449-46d8-b751-d001dc7bd041-kube-api-access-vs2qj\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:00.976534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qxqg\" (UniqueName: \"kubernetes.io/projected/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-kube-api-access-5qxqg\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.976534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-ovnkube-script-lib\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.976534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxh2b\" (UniqueName: \"kubernetes.io/projected/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-kube-api-access-wxh2b\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.976534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-host\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.976534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976468 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-system-cni-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.976534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/63a30a0d-2d40-4d25-9446-8396ef1c1a36-hosts-file\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976663 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22nfn\" (UniqueName: \"kubernetes.io/projected/63a30a0d-2d40-4d25-9446-8396ef1c1a36-kube-api-access-22nfn\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976673 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-host\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-device-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysctl-conf\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976769 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-device-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976783 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9h7w\" (UniqueName: \"kubernetes.io/projected/42c664f1-4272-4f64-9f85-76c5d3bc909e-kube-api-access-x9h7w\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-system-cni-dir\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-sys-fs\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bce55014-ddb8-4cd4-9652-b44f92053d6f-dbus\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-host-slash\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976953 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysctl-conf\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.976974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-kubelet\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-var-lib-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-log-socket\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.977070 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977090 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bce55014-ddb8-4cd4-9652-b44f92053d6f-dbus\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.976953 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-sys-fs\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-systemd\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977168 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-var-lib-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.977199 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:15:01.47717188 +0000 UTC m=+2.972196396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-cni-multus\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977239 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977229 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-host-slash\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977281 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-systemd\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977177 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-log-socket\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/674cda71-7265-4222-a544-462259875c68-agent-certs\") pod \"konnectivity-agent-9nxr8\" (UID: \"674cda71-7265-4222-a544-462259875c68\") " pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:00.977654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-cni-netd\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysconfig\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-multus-certs\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-cni-netd\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977427 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysconfig\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-cnibin\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977478 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3b765d1-889d-4154-9f56-408bd962bbd4-host\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-slash\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-cni-bin\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977556 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3b765d1-889d-4154-9f56-408bd962bbd4-host\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977570 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-ovnkube-script-lib\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-var-lib-kubelet\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977605 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-slash\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-tmp\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-cni-bin\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5tbc\" (UniqueName: \"kubernetes.io/projected/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-kube-api-access-q5tbc\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.978509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-etc-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-var-lib-kubelet\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwr8q\" (UniqueName: \"kubernetes.io/projected/f3b765d1-889d-4154-9f56-408bd962bbd4-kube-api-access-cwr8q\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-kubelet\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-hostroot\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977872 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977923 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-systemd\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977976 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-etc-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978022 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-kubelet\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.977883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-systemd\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978069 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-openvswitch\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-ovnkube-config\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-tuned\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-os-release\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72qhs\" (UniqueName: \"kubernetes.io/projected/9536b688-9423-45be-994c-38aa1697af9c-kube-api-access-72qhs\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/674cda71-7265-4222-a544-462259875c68-konnectivity-ca\") pod \"konnectivity-agent-9nxr8\" (UID: \"674cda71-7265-4222-a544-462259875c68\") " pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:00.979409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-registration-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-cni-bin\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82fde3a3-524c-46f5-9057-526594cff32b-ovn-node-metrics-cert\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-kubernetes\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42c664f1-4272-4f64-9f85-76c5d3bc909e-cni-binary-copy\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3b765d1-889d-4154-9f56-408bd962bbd4-serviceca\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978422 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-systemd-units\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysctl-d\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978453 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-run\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-cni-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978523 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-socket-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-cnibin\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-ovn\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-node-log\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-env-overrides\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.980443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978661 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-ovnkube-config\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978735 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-run-netns\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-run-netns\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978763 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-kubernetes\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn28n\" (UniqueName: \"kubernetes.io/projected/82fde3a3-524c-46f5-9057-526594cff32b-kube-api-access-rn28n\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-socket-dir-parent\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978815 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-k8s-cni-cncf-io\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-lib-modules\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978846 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bce55014-ddb8-4cd4-9652-b44f92053d6f-kubelet-config\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-iptables-alerter-script\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-modprobe-d\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.978981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-os-release\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-netns\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-daemon-config\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.981316 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-sys\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-conf-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-etc-kubernetes\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a30a0d-2d40-4d25-9446-8396ef1c1a36-tmp-dir\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979162 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f3b765d1-889d-4154-9f56-408bd962bbd4-serviceca\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979272 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979376 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-socket-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-run-ovn\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979491 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-node-log\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979495 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.979679 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:00.979731 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:01.479714083 +0000 UTC m=+2.974738597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-lib-modules\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979886 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bce55014-ddb8-4cd4-9652-b44f92053d6f-kubelet-config\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.979945 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-registration-dir\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980091 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82fde3a3-524c-46f5-9057-526594cff32b-env-overrides\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.982165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980272 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82fde3a3-524c-46f5-9057-526594cff32b-systemd-units\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-sysctl-d\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980404 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-run\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980468 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-modprobe-d\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980475 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-iptables-alerter-script\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.980523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-sys\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.981963 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82fde3a3-524c-46f5-9057-526594cff32b-ovn-node-metrics-cert\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.983588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.982870 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-tmp\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.984847 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.984452 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qxqg\" (UniqueName: \"kubernetes.io/projected/8a352a4d-822d-4bad-ab93-d74bb9f9c87f-kube-api-access-5qxqg\") pod \"aws-ebs-csi-driver-node-7xmtp\" (UID: \"8a352a4d-822d-4bad-ab93-d74bb9f9c87f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:00.987027 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.987008 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxh2b\" (UniqueName: \"kubernetes.io/projected/f126c22a-dbc5-4937-b8ee-2b6181db7d5c-kube-api-access-wxh2b\") pod \"iptables-alerter-jsvbf\" (UID: \"f126c22a-dbc5-4937-b8ee-2b6181db7d5c\") " pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:00.987544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.987454 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-etc-tuned\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.987698 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.987677 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn28n\" (UniqueName: \"kubernetes.io/projected/82fde3a3-524c-46f5-9057-526594cff32b-kube-api-access-rn28n\") pod \"ovnkube-node-cvqzg\" (UID: \"82fde3a3-524c-46f5-9057-526594cff32b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:00.989411 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.989391 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5tbc\" (UniqueName: \"kubernetes.io/projected/b22d35e1-a1ca-41aa-9501-5c78edf43cb5-kube-api-access-q5tbc\") pod \"tuned-cnc7g\" (UID: \"b22d35e1-a1ca-41aa-9501-5c78edf43cb5\") " pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:00.989501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.989465 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwr8q\" (UniqueName: \"kubernetes.io/projected/f3b765d1-889d-4154-9f56-408bd962bbd4-kube-api-access-cwr8q\") pod \"node-ca-hk8cw\" (UID: \"f3b765d1-889d-4154-9f56-408bd962bbd4\") " pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:00.989993 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:00.989972 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs2qj\" (UniqueName: \"kubernetes.io/projected/e6ba5b83-9449-46d8-b751-d001dc7bd041-kube-api-access-vs2qj\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:01.080295 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42c664f1-4272-4f64-9f85-76c5d3bc909e-cni-binary-copy\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-cni-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-cnibin\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-socket-dir-parent\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-cni-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-k8s-cni-cncf-io\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-os-release\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-netns\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-daemon-config\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-conf-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-etc-kubernetes\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a30a0d-2d40-4d25-9446-8396ef1c1a36-tmp-dir\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-system-cni-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080672 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/63a30a0d-2d40-4d25-9446-8396ef1c1a36-hosts-file\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22nfn\" (UniqueName: \"kubernetes.io/projected/63a30a0d-2d40-4d25-9446-8396ef1c1a36-kube-api-access-22nfn\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080704 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9h7w\" (UniqueName: \"kubernetes.io/projected/42c664f1-4272-4f64-9f85-76c5d3bc909e-kube-api-access-x9h7w\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-system-cni-dir\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-kubelet\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-cni-multus\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080810 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-cnibin\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/674cda71-7265-4222-a544-462259875c68-agent-certs\") pod \"konnectivity-agent-9nxr8\" (UID: \"674cda71-7265-4222-a544-462259875c68\") " pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:01.080887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-multus-certs\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-cnibin\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-hostroot\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-os-release\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72qhs\" (UniqueName: \"kubernetes.io/projected/9536b688-9423-45be-994c-38aa1697af9c-kube-api-access-72qhs\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/674cda71-7265-4222-a544-462259875c68-konnectivity-ca\") pod \"konnectivity-agent-9nxr8\" (UID: \"674cda71-7265-4222-a544-462259875c68\") " pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080976 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42c664f1-4272-4f64-9f85-76c5d3bc909e-cni-binary-copy\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.080992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-cni-bin\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081054 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081070 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-system-cni-dir\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081263 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-cni-bin\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081296 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-cni-multus\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-system-cni-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081331 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081414 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/63a30a0d-2d40-4d25-9446-8396ef1c1a36-hosts-file\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081473 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-socket-dir-parent\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.081728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081486 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9536b688-9423-45be-994c-38aa1697af9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081510 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-multus-certs\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-var-lib-kubelet\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081554 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-conf-dir\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081558 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/674cda71-7265-4222-a544-462259875c68-konnectivity-ca\") pod \"konnectivity-agent-9nxr8\" (UID: \"674cda71-7265-4222-a544-462259875c68\") " pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-os-release\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081682 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-cnibin\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-netns\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081717 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-hostroot\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081727 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-etc-kubernetes\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a30a0d-2d40-4d25-9446-8396ef1c1a36-tmp-dir\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9536b688-9423-45be-994c-38aa1697af9c-os-release\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.082463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.081863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42c664f1-4272-4f64-9f85-76c5d3bc909e-host-run-k8s-cni-cncf-io\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.082952 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.082699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42c664f1-4272-4f64-9f85-76c5d3bc909e-multus-daemon-config\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.084266 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.084232 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/674cda71-7265-4222-a544-462259875c68-agent-certs\") pod \"konnectivity-agent-9nxr8\" (UID: \"674cda71-7265-4222-a544-462259875c68\") " pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:01.086574 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.086553 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:01.086574 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.086577 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:01.086751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.086590 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:01.086751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.086681 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:01.586663063 +0000 UTC m=+3.081687591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:01.089162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.089135 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9h7w\" (UniqueName: \"kubernetes.io/projected/42c664f1-4272-4f64-9f85-76c5d3bc909e-kube-api-access-x9h7w\") pod \"multus-gxzvt\" (UID: \"42c664f1-4272-4f64-9f85-76c5d3bc909e\") " pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.089573 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.089555 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22nfn\" (UniqueName: \"kubernetes.io/projected/63a30a0d-2d40-4d25-9446-8396ef1c1a36-kube-api-access-22nfn\") pod \"node-resolver-cdthv\" (UID: \"63a30a0d-2d40-4d25-9446-8396ef1c1a36\") " pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.089717 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.089698 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72qhs\" (UniqueName: \"kubernetes.io/projected/9536b688-9423-45be-994c-38aa1697af9c-kube-api-access-72qhs\") pod \"multus-additional-cni-plugins-848sh\" (UID: \"9536b688-9423-45be-994c-38aa1697af9c\") " pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.166691 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.166589 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:01.179885 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.179846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" Jul 07 02:15:01.191786 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.191754 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jsvbf" Jul 07 02:15:01.198731 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.198708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" Jul 07 02:15:01.206581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.206560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hk8cw" Jul 07 02:15:01.218280 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.218248 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cdthv" Jul 07 02:15:01.220108 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.220091 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:15:01.226713 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.226690 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-848sh" Jul 07 02:15:01.235398 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.235373 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:01.240260 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.240239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxzvt" Jul 07 02:15:01.483328 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.483299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:01.483506 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.483381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:01.483506 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.483452 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:01.483506 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.483456 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:01.483620 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.483513 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:15:02.483497154 +0000 UTC m=+3.978521664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:01.483620 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.483531 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:02.483523359 +0000 UTC m=+3.978547872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:01.684679 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.684577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:01.684858 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.684781 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:01.684858 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.684807 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:01.684858 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.684820 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:01.685031 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:01.684883 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:02.684865191 +0000 UTC m=+4.179889723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:01.892693 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.892668 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a352a4d_822d_4bad_ab93_d74bb9f9c87f.slice/crio-45da19e389bcc84bccc5bfbd4bf7d535fff26af260333e590bf6a7234222cb1a WatchSource:0}: Error finding container 45da19e389bcc84bccc5bfbd4bf7d535fff26af260333e590bf6a7234222cb1a: Status 404 returned error can't find the container with id 45da19e389bcc84bccc5bfbd4bf7d535fff26af260333e590bf6a7234222cb1a Jul 07 02:15:01.896799 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.896767 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf126c22a_dbc5_4937_b8ee_2b6181db7d5c.slice/crio-f0d94ddf341ec2269162f2041c58efa63a2fd14bdd591a09e84d6ec3090fa021 WatchSource:0}: Error finding container f0d94ddf341ec2269162f2041c58efa63a2fd14bdd591a09e84d6ec3090fa021: Status 404 returned error can't find the container with id f0d94ddf341ec2269162f2041c58efa63a2fd14bdd591a09e84d6ec3090fa021 Jul 07 02:15:01.899468 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.899442 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c664f1_4272_4f64_9f85_76c5d3bc909e.slice/crio-6a34f3f499c2b2ae5a7986cde5a7f11677e7827cb0a053061dead98c47dea2aa WatchSource:0}: Error finding container 6a34f3f499c2b2ae5a7986cde5a7f11677e7827cb0a053061dead98c47dea2aa: Status 404 returned error can't find the container with id 6a34f3f499c2b2ae5a7986cde5a7f11677e7827cb0a053061dead98c47dea2aa Jul 07 02:15:01.902063 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.901985 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22d35e1_a1ca_41aa_9501_5c78edf43cb5.slice/crio-f5ba2f7824599a21d4d07b9b81a8b6ff63ade90e6d25d2f6bfe062ffacdc2c37 WatchSource:0}: Error finding container f5ba2f7824599a21d4d07b9b81a8b6ff63ade90e6d25d2f6bfe062ffacdc2c37: Status 404 returned error can't find the container with id f5ba2f7824599a21d4d07b9b81a8b6ff63ade90e6d25d2f6bfe062ffacdc2c37 Jul 07 02:15:01.902664 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.902613 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674cda71_7265_4222_a544_462259875c68.slice/crio-6b4f5ed256ebd15c0046b4bf828abaccc5fd3952cfc439503922e85c334f3700 WatchSource:0}: Error finding container 6b4f5ed256ebd15c0046b4bf828abaccc5fd3952cfc439503922e85c334f3700: Status 404 returned error can't find the container with id 6b4f5ed256ebd15c0046b4bf828abaccc5fd3952cfc439503922e85c334f3700 Jul 07 02:15:01.903425 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.903384 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9536b688_9423_45be_994c_38aa1697af9c.slice/crio-123347b8831e5222221c55fbf5698183507d73e0c0e0b33c45122abd8b2e35ae WatchSource:0}: Error finding container 123347b8831e5222221c55fbf5698183507d73e0c0e0b33c45122abd8b2e35ae: Status 404 returned error can't find the container with id 123347b8831e5222221c55fbf5698183507d73e0c0e0b33c45122abd8b2e35ae Jul 07 02:15:01.906778 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.906756 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b765d1_889d_4154_9f56_408bd962bbd4.slice/crio-d3d8a020444340251f36d1709855e9c70de444931a51e293c30cac9a1c6cd5be WatchSource:0}: Error finding container d3d8a020444340251f36d1709855e9c70de444931a51e293c30cac9a1c6cd5be: Status 404 returned error can't find the container with id d3d8a020444340251f36d1709855e9c70de444931a51e293c30cac9a1c6cd5be Jul 07 02:15:01.907758 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.907735 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fde3a3_524c_46f5_9057_526594cff32b.slice/crio-0c1c1df116dcb777e0c1bbefcc29f0b0f8e068da5a65b745c18fdc12854ca01a WatchSource:0}: Error finding container 0c1c1df116dcb777e0c1bbefcc29f0b0f8e068da5a65b745c18fdc12854ca01a: Status 404 returned error can't find the container with id 0c1c1df116dcb777e0c1bbefcc29f0b0f8e068da5a65b745c18fdc12854ca01a Jul 07 02:15:01.907864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.907831 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:10:00 +0000 UTC" deadline="2028-03-19 11:16:03.209164386 +0000 UTC" Jul 07 02:15:01.907864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:01.907855 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14913h1m1.301313934s" Jul 07 02:15:01.908608 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:01.908420 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a30a0d_2d40_4d25_9446_8396ef1c1a36.slice/crio-ae721058b0085be07bf8447733568bec7765f28da8e6401ab24aa4ebaa0fb40e WatchSource:0}: Error finding container ae721058b0085be07bf8447733568bec7765f28da8e6401ab24aa4ebaa0fb40e: Status 404 returned error can't find the container with id ae721058b0085be07bf8447733568bec7765f28da8e6401ab24aa4ebaa0fb40e Jul 07 02:15:02.046041 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.045843 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" event={"ID":"8a352a4d-822d-4bad-ab93-d74bb9f9c87f","Type":"ContainerStarted","Data":"45da19e389bcc84bccc5bfbd4bf7d535fff26af260333e590bf6a7234222cb1a"} Jul 07 02:15:02.047981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.047951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cdthv" event={"ID":"63a30a0d-2d40-4d25-9446-8396ef1c1a36","Type":"ContainerStarted","Data":"ae721058b0085be07bf8447733568bec7765f28da8e6401ab24aa4ebaa0fb40e"} Jul 07 02:15:02.051601 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.051568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hk8cw" event={"ID":"f3b765d1-889d-4154-9f56-408bd962bbd4","Type":"ContainerStarted","Data":"d3d8a020444340251f36d1709855e9c70de444931a51e293c30cac9a1c6cd5be"} Jul 07 02:15:02.052659 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.052621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" event={"ID":"b22d35e1-a1ca-41aa-9501-5c78edf43cb5","Type":"ContainerStarted","Data":"f5ba2f7824599a21d4d07b9b81a8b6ff63ade90e6d25d2f6bfe062ffacdc2c37"} Jul 07 02:15:02.054162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.054143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxzvt" event={"ID":"42c664f1-4272-4f64-9f85-76c5d3bc909e","Type":"ContainerStarted","Data":"6a34f3f499c2b2ae5a7986cde5a7f11677e7827cb0a053061dead98c47dea2aa"} Jul 07 02:15:02.057173 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.057152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jsvbf" event={"ID":"f126c22a-dbc5-4937-b8ee-2b6181db7d5c","Type":"ContainerStarted","Data":"f0d94ddf341ec2269162f2041c58efa63a2fd14bdd591a09e84d6ec3090fa021"} Jul 07 02:15:02.062579 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.062542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" event={"ID":"2ce2cf4076b6f479baf250b405f7ccd8","Type":"ContainerStarted","Data":"ce1a2a58c939b49795d04a82333aa5526dd9c737d0c012c8fbaf6beec1fa10be"} Jul 07 02:15:02.063680 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.063657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"0c1c1df116dcb777e0c1bbefcc29f0b0f8e068da5a65b745c18fdc12854ca01a"} Jul 07 02:15:02.064564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.064540 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerStarted","Data":"123347b8831e5222221c55fbf5698183507d73e0c0e0b33c45122abd8b2e35ae"} Jul 07 02:15:02.065572 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.065539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9nxr8" event={"ID":"674cda71-7265-4222-a544-462259875c68","Type":"ContainerStarted","Data":"6b4f5ed256ebd15c0046b4bf828abaccc5fd3952cfc439503922e85c334f3700"} Jul 07 02:15:02.076474 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.076419 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-186.ec2.internal" podStartSLOduration=2.076403199 podStartE2EDuration="2.076403199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:02.075708583 +0000 UTC m=+3.570733115" watchObservedRunningTime="2026-07-07 02:15:02.076403199 +0000 UTC m=+3.571427730" Jul 07 02:15:02.489813 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.489771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:02.490001 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.489873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:02.490066 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.489999 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:02.490066 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.490053 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:04.490039732 +0000 UTC m=+5.985064243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:02.490425 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.490406 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:02.490498 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.490463 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:15:04.490448256 +0000 UTC m=+5.985472770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:02.691545 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.691496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:02.691865 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.691768 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:02.691865 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.691791 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:02.691865 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.691804 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:02.691865 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:02.691865 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:04.69184604 +0000 UTC m=+6.186870562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:02.909019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.908894 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:10:00 +0000 UTC" deadline="2028-01-08 13:24:08.937559853 +0000 UTC" Jul 07 02:15:02.909019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:02.908960 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13211h9m6.028603493s" Jul 07 02:15:03.036791 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:03.036757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:03.036960 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:03.036890 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:03.037353 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:03.037326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:03.037468 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:03.037427 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:03.037887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:03.037869 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:03.037994 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:03.037966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:03.088213 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:03.088170 2556 generic.go:356] "Generic (PLEG): container finished" podID="58eb8b9783df7fd776c87f7b113a061f" containerID="c5704fecaee5873f88afc4f54d3b441780317519a0c51300f55db182c3d801c8" exitCode=0 Jul 07 02:15:03.088382 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:03.088337 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" event={"ID":"58eb8b9783df7fd776c87f7b113a061f","Type":"ContainerDied","Data":"c5704fecaee5873f88afc4f54d3b441780317519a0c51300f55db182c3d801c8"} Jul 07 02:15:04.109679 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:04.108946 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" event={"ID":"58eb8b9783df7fd776c87f7b113a061f","Type":"ContainerStarted","Data":"e26fcc3f752f1261906384959401498c3ff4bc45e5ac2dd208d4413b69aebe62"} Jul 07 02:15:04.126109 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:04.125024 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-186.ec2.internal" podStartSLOduration=4.125002293 podStartE2EDuration="4.125002293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:04.124711437 +0000 UTC m=+5.619735969" watchObservedRunningTime="2026-07-07 02:15:04.125002293 +0000 UTC m=+5.620026826" Jul 07 02:15:04.508706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:04.508597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:04.508916 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:04.508723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:04.508916 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.508861 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:04.509028 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.508931 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:08.508909111 +0000 UTC m=+10.003933643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:04.509421 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.509401 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:04.509503 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.509458 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:15:08.50944336 +0000 UTC m=+10.004467884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:04.711047 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:04.711008 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:04.711245 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.711227 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:04.711288 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.711256 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:04.711288 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.711269 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:04.711393 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:04.711331 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:08.711311961 +0000 UTC m=+10.206336472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:05.037335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:05.036821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:05.037335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:05.036857 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:05.037335 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:05.036950 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:05.037335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:05.037038 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:05.037335 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:05.037148 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:05.037335 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:05.037248 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:07.037321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:07.036526 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:07.037321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:07.036552 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:07.037321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:07.036578 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:07.037321 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:07.036705 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:07.037321 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:07.037133 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:07.037321 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:07.037219 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:08.546831 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:08.546793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:08.547438 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:08.546874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:08.547438 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.547002 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:08.547438 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.547064 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:16.547042996 +0000 UTC m=+18.042067508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:08.547617 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.547438 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:08.547617 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.547490 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:15:16.547474352 +0000 UTC m=+18.042498862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:08.748424 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:08.748393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:08.748675 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.748578 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:08.748675 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.748604 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:08.748675 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.748617 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:08.748852 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:08.748695 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:16.748677088 +0000 UTC m=+18.243701600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:09.037685 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:09.037590 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:09.037841 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:09.037737 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:09.038758 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:09.038735 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:09.038873 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:09.038837 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:09.038873 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:09.038870 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:09.038974 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:09.038913 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:11.037241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:11.036758 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:11.037241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:11.036781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:11.037241 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:11.036887 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:11.037241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:11.036952 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:11.037241 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:11.037045 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:11.037241 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:11.037114 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:13.036243 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:13.036210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:13.036243 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:13.036243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:13.036751 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:13.036207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:13.036751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:13.036355 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:13.036751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:13.036475 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:13.036751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:13.036599 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:15.036091 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:15.036054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:15.036461 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:15.036184 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:15.036461 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:15.036191 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:15.036461 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:15.036295 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:15.036461 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:15.036342 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:15.036461 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:15.036403 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:16.607213 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:16.607177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:16.607213 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:16.607222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:16.607756 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.607315 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:16.607756 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.607319 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:16.607756 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.607364 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:15:32.607350649 +0000 UTC m=+34.102375162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:16.607756 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.607379 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:32.607372436 +0000 UTC m=+34.102396946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:16.808580 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:16.808545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:16.808751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.808718 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:16.808751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.808735 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:16.808751 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.808744 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:16.808850 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:16.808795 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:32.808779995 +0000 UTC m=+34.303804523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:17.036548 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:17.036465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:17.036548 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:17.036503 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:17.036797 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:17.036575 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:17.036797 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:17.036466 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:17.036797 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:17.036699 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:17.036959 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:17.036806 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:19.037004 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:19.036966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:19.037409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:19.037060 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:19.037409 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:19.037081 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:19.037409 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:19.037175 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:19.037409 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:19.037176 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:19.037409 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:19.037273 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:21.036090 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:21.036051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:21.036537 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:21.036192 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:21.036537 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:21.036059 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:21.036537 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:21.036290 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:21.036537 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:21.036052 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:21.036537 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:21.036367 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:22.161553 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.161119 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" event={"ID":"8a352a4d-822d-4bad-ab93-d74bb9f9c87f","Type":"ContainerStarted","Data":"1343bae0270dd0699c4ef60484887f5229800807be27f2751fb50df61bb19448"} Jul 07 02:15:22.162932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.162899 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cdthv" event={"ID":"63a30a0d-2d40-4d25-9446-8396ef1c1a36","Type":"ContainerStarted","Data":"ab92fa41e25bd2689d9f6fea583f9b6ffe3ae92317b29f1c23328df230b62814"} Jul 07 02:15:22.166353 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.166326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hk8cw" event={"ID":"f3b765d1-889d-4154-9f56-408bd962bbd4","Type":"ContainerStarted","Data":"7f5fe6ee907655477d39934484c74ceb04946cf6ccb6d8ffbb2aeca55136a2dd"} Jul 07 02:15:22.168645 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.168615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" event={"ID":"b22d35e1-a1ca-41aa-9501-5c78edf43cb5","Type":"ContainerStarted","Data":"4e05a7e757005b13710fb19f4752ae6b739e8727c2b6836080bedd2902a21909"} Jul 07 02:15:22.170848 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.170822 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxzvt" event={"ID":"42c664f1-4272-4f64-9f85-76c5d3bc909e","Type":"ContainerStarted","Data":"339dde01f3b6919642aef687f42d19bec1127f759645175bd56db0cef4606f59"} Jul 07 02:15:22.173704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.173687 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:15:22.174059 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174037 2556 generic.go:356] "Generic (PLEG): container finished" podID="82fde3a3-524c-46f5-9057-526594cff32b" containerID="3ae60d28e89d6925647c1d383a7053579d7c4569629c1321b695812447054982" exitCode=1 Jul 07 02:15:22.174174 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174109 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"07f90023e5aa6adf8f85ddbbea918603b061698fef77468c2591be48320c0dbe"} Jul 07 02:15:22.174229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174195 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"1415fd16cfb57a3b4e3708fb286138aee20bc6ca47d23d381b6488959a6589b2"} Jul 07 02:15:22.174280 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"9bab71f6a354c954ac397f04d1ce37a062e24693c84d6e1e3c38c924aac826c1"} Jul 07 02:15:22.174347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"fda6d3c965d82ce674e33661c2272f0cfcb04c1666b3c49c00f455c075087fb5"} Jul 07 02:15:22.174385 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174349 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerDied","Data":"3ae60d28e89d6925647c1d383a7053579d7c4569629c1321b695812447054982"} Jul 07 02:15:22.174426 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.174395 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"953f23cc8b84a8da68b938d379f7bdae1b5df0e8b3c54e3303e2d233e0ab3633"} Jul 07 02:15:22.178895 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.178867 2556 generic.go:356] "Generic (PLEG): container finished" podID="9536b688-9423-45be-994c-38aa1697af9c" containerID="484962c1895b93d6d7593fd5e78f5555a9f353211938b6f1e163adcf3afa6f4d" exitCode=0 Jul 07 02:15:22.179030 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.178947 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerDied","Data":"484962c1895b93d6d7593fd5e78f5555a9f353211938b6f1e163adcf3afa6f4d"} Jul 07 02:15:22.180158 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.179628 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cdthv" podStartSLOduration=4.028851951 podStartE2EDuration="23.179615185s" totalImagesPullingTime="19.150763234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:22.178853387 +0000 UTC m=+23.673877920" watchObservedRunningTime="2026-07-07 02:15:22.179615185 +0000 UTC m=+23.674639715" Jul 07 02:15:22.180492 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.180454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9nxr8" event={"ID":"674cda71-7265-4222-a544-462259875c68","Type":"ContainerStarted","Data":"c95062d0d0835e8e6a236e86f862c8ffd3e56389f73bddbc72cf78662bee740e"} Jul 07 02:15:22.220477 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.220411 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cnc7g" podStartSLOduration=4.039175585 podStartE2EDuration="23.220389943s" totalImagesPullingTime="19.181214358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:22.198494141 +0000 UTC m=+23.693518673" watchObservedRunningTime="2026-07-07 02:15:22.220389943 +0000 UTC m=+23.715414474" Jul 07 02:15:22.220723 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.220694 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gxzvt" podStartSLOduration=3.978899423 podStartE2EDuration="23.220680681s" totalImagesPullingTime="19.241781258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:22.220107956 +0000 UTC m=+23.715132489" watchObservedRunningTime="2026-07-07 02:15:22.220680681 +0000 UTC m=+23.715705213" Jul 07 02:15:22.241288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.241239 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hk8cw" podStartSLOduration=4.091549292 podStartE2EDuration="23.241223329s" totalImagesPullingTime="19.149674037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:22.240815482 +0000 UTC m=+23.735840015" watchObservedRunningTime="2026-07-07 02:15:22.241223329 +0000 UTC m=+23.736247861" Jul 07 02:15:22.293798 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.293754 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9nxr8" podStartSLOduration=8.350079714 podStartE2EDuration="23.293737243s" totalImagesPullingTime="14.943657529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:22.293095234 +0000 UTC m=+23.788119764" watchObservedRunningTime="2026-07-07 02:15:22.293737243 +0000 UTC m=+23.788761775" Jul 07 02:15:22.336345 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.336306 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:22.401659 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.401543 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:22.520665 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.520626 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:22.636154 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.636126 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 02:15:22.931198 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.931085 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T02:15:22.636145351Z","UUID":"c0c1912d-e20c-4a66-bdac-95f2057caa8c","Handler":null,"Name":"","Endpoint":""} Jul 07 02:15:22.932487 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.932466 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 02:15:22.932616 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:22.932500 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 02:15:23.036545 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.036515 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:23.036730 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.036514 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:23.036730 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:23.036627 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:23.036817 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:23.036732 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:23.036817 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.036521 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:23.036937 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:23.036836 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:23.185974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.185894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" event={"ID":"8a352a4d-822d-4bad-ab93-d74bb9f9c87f","Type":"ContainerStarted","Data":"cbf14f4035b1a4c2f6ac51194dc1274fa8f3e0bd2485595074143a57c76b2b4a"} Jul 07 02:15:23.189617 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.189180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jsvbf" event={"ID":"f126c22a-dbc5-4937-b8ee-2b6181db7d5c","Type":"ContainerStarted","Data":"6fa55ca1c161daca9ceb170d958d43aadd0da76db3e62a57e78e946454beabde"} Jul 07 02:15:23.328346 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.328298 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:23.384380 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:23.384353 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:24.193367 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.193060 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:15:24.193782 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.193757 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"1acf0c81b913c3e6f24498659823d80f6b2b55142839b7da65be6fd9d344d4d6"} Jul 07 02:15:24.195817 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.195792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" event={"ID":"8a352a4d-822d-4bad-ab93-d74bb9f9c87f","Type":"ContainerStarted","Data":"343faa72265254b2332d1694f9eb779a6d462019cbdb56d73ebb0f2629c8ea11"} Jul 07 02:15:24.211755 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.211705 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xmtp" podStartSLOduration=3.754107057 podStartE2EDuration="25.211690854s" totalImagesPullingTime="21.457583797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:24.211182274 +0000 UTC m=+25.706206817" watchObservedRunningTime="2026-07-07 02:15:24.211690854 +0000 UTC m=+25.706715385" Jul 07 02:15:24.212037 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.212011 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jsvbf" podStartSLOduration=6.027336815 podStartE2EDuration="25.212003918s" totalImagesPullingTime="19.184667103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:23.205239578 +0000 UTC m=+24.700264109" watchObservedRunningTime="2026-07-07 02:15:24.212003918 +0000 UTC m=+25.707028494" Jul 07 02:15:24.750654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.750597 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:24.806050 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:24.806022 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:25.036375 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:25.036288 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:25.036546 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:25.036297 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:25.036546 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:25.036413 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:25.036546 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:25.036466 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:25.036716 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:25.036560 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:25.036716 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:25.036653 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:25.575989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:25.575949 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:25.576551 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:25.576535 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:26.204457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.204435 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:15:26.204899 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.204873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"95333e932d14dc6de1e0f19dff8703d07080ce4f2db1d324c57944cf923109d3"} Jul 07 02:15:26.205329 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.205308 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:26.205736 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.205613 2556 scope.go:117] "RemoveContainer" containerID="3ae60d28e89d6925647c1d383a7053579d7c4569629c1321b695812447054982" Jul 07 02:15:26.205850 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.205833 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:26.205916 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.205906 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9nxr8" Jul 07 02:15:26.226037 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.225764 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:26.287536 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:26.287466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:27.036769 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.036739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:27.037509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.036742 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:27.037509 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:27.036876 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:27.037509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.036741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:27.037509 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:27.036976 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:27.037509 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:27.037073 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:27.211938 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.211906 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:15:27.212517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.212495 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 02:15:27.212746 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.212715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" event={"ID":"82fde3a3-524c-46f5-9057-526594cff32b","Type":"ContainerStarted","Data":"a7ed43c7712db7606fc6ee60bc7ecfdf72f6409c9b4de2d56fb20e84db773261"} Jul 07 02:15:27.212840 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.212811 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:27.231173 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.231146 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:27.238939 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.238885 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" podStartSLOduration=9.000924094 podStartE2EDuration="28.23886665s" totalImagesPullingTime="19.237942556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:27.238254428 +0000 UTC m=+28.733278960" watchObservedRunningTime="2026-07-07 02:15:27.23886665 +0000 UTC m=+28.733891180" Jul 07 02:15:27.350964 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.350885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:27.433420 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:27.433387 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:28.060778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.060741 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bcqjb"] Jul 07 02:15:28.061223 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.060920 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:28.061223 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:28.061027 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:28.061549 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.061527 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qtjbj"] Jul 07 02:15:28.061681 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.061666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:28.061801 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:28.061771 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:28.062554 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.062523 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w2kkp"] Jul 07 02:15:28.062660 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.062648 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:28.062779 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:28.062758 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:28.214811 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.214778 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 02:15:28.742737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.742485 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:28.804216 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:28.804187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:29.218684 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:29.218623 2556 generic.go:356] "Generic (PLEG): container finished" podID="9536b688-9423-45be-994c-38aa1697af9c" containerID="c0f5d3f4279cf83a7ea1b5b24a820b56208523c46266d3eb559144b56990b5d9" exitCode=0 Jul 07 02:15:29.219072 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:29.218707 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerDied","Data":"c0f5d3f4279cf83a7ea1b5b24a820b56208523c46266d3eb559144b56990b5d9"} Jul 07 02:15:29.219072 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:29.218795 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 02:15:29.688373 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:29.688275 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:29.742610 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:29.742568 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:30.035807 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:30.035776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:30.035807 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:30.035798 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:30.036012 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:30.035778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:30.036012 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:30.035914 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:30.036109 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:30.036020 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:30.036109 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:30.036085 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:30.223515 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:30.223434 2556 generic.go:356] "Generic (PLEG): container finished" podID="9536b688-9423-45be-994c-38aa1697af9c" containerID="ea86097579d011373a08149ae97d754d21d3c9845f19b1231b76e2d35f56de50" exitCode=0 Jul 07 02:15:30.223515 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:30.223485 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerDied","Data":"ea86097579d011373a08149ae97d754d21d3c9845f19b1231b76e2d35f56de50"} Jul 07 02:15:30.440041 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:30.440002 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:15:31.228417 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:31.228386 2556 generic.go:356] "Generic (PLEG): container finished" podID="9536b688-9423-45be-994c-38aa1697af9c" containerID="08d74480fc0d2acdbb0dfea1081de696f3cfdf0111f24df4549f1fa8e774c1d0" exitCode=0 Jul 07 02:15:31.228944 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:31.228435 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerDied","Data":"08d74480fc0d2acdbb0dfea1081de696f3cfdf0111f24df4549f1fa8e774c1d0"} Jul 07 02:15:32.036231 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:32.036197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:32.036422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:32.036211 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:32.036422 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.036322 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:32.036422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:32.036348 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:32.036596 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.036451 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:32.036596 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.036549 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:32.619935 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:32.619900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:32.620431 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:32.619988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:32.620431 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.620119 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:32.620431 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.620180 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:04.620162296 +0000 UTC m=+66.115186825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:15:32.620652 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.620613 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:32.620723 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.620695 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret podName:bce55014-ddb8-4cd4-9652-b44f92053d6f nodeName:}" failed. No retries permitted until 2026-07-07 02:16:04.620679285 +0000 UTC m=+66.115703798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret") pod "global-pull-secret-syncer-qtjbj" (UID: "bce55014-ddb8-4cd4-9652-b44f92053d6f") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:15:32.821585 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:32.821542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:32.821772 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.821726 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:15:32.821772 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.821747 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:15:32.821772 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.821756 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4qshx for pod openshift-network-diagnostics/network-check-target-bcqjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:32.821908 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:32.821827 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx podName:19a5c7fa-1546-4354-83f7-6f114abe1007 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:04.821792768 +0000 UTC m=+66.316817278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qshx" (UniqueName: "kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx") pod "network-check-target-bcqjb" (UID: "19a5c7fa-1546-4354-83f7-6f114abe1007") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:15:34.036696 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.036656 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:34.036696 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.036682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:34.037182 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.036708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:34.037182 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:34.036776 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcqjb" podUID="19a5c7fa-1546-4354-83f7-6f114abe1007" Jul 07 02:15:34.037182 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:34.036932 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:15:34.037182 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:34.037030 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtjbj" podUID="bce55014-ddb8-4cd4-9652-b44f92053d6f" Jul 07 02:15:34.785337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.785309 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-186.ec2.internal" event="NodeReady" Jul 07 02:15:34.785518 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.785456 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 02:15:34.829385 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.829349 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mlkk2"] Jul 07 02:15:34.833921 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.833899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:34.835769 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.835739 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qnzc2"] Jul 07 02:15:34.836508 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.836460 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nr4jk\"" Jul 07 02:15:34.836741 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.836722 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 02:15:34.836828 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.836794 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 02:15:34.839740 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.839719 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:34.842350 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.842187 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rpvcs\"" Jul 07 02:15:34.842350 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.842194 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 02:15:34.842350 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.842269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 02:15:34.842889 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.842620 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 02:15:34.844607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.844586 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mlkk2"] Jul 07 02:15:34.850474 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.850449 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnzc2"] Jul 07 02:15:34.936357 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.936270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70b356e7-a809-4a2a-90b2-abf3a67dabed-cert\") pod \"ingress-canary-qnzc2\" (UID: \"70b356e7-a809-4a2a-90b2-abf3a67dabed\") " pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:34.936357 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.936310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2d6d\" (UniqueName: \"kubernetes.io/projected/f70d3d34-c676-42d0-973a-b6e0194e4536-kube-api-access-s2d6d\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:34.936357 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.936353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kd6\" (UniqueName: \"kubernetes.io/projected/70b356e7-a809-4a2a-90b2-abf3a67dabed-kube-api-access-86kd6\") pod \"ingress-canary-qnzc2\" (UID: \"70b356e7-a809-4a2a-90b2-abf3a67dabed\") " pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:34.936597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.936456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:34.936597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.936527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f70d3d34-c676-42d0-973a-b6e0194e4536-config-volume\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:34.936597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.936553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f70d3d34-c676-42d0-973a-b6e0194e4536-tmp-dir\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:34.965925 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:34.965887 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:35.025352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.025319 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:35.037696 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.037667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70b356e7-a809-4a2a-90b2-abf3a67dabed-cert\") pod \"ingress-canary-qnzc2\" (UID: \"70b356e7-a809-4a2a-90b2-abf3a67dabed\") " pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:35.038145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.037710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2d6d\" (UniqueName: \"kubernetes.io/projected/f70d3d34-c676-42d0-973a-b6e0194e4536-kube-api-access-s2d6d\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.038145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.037753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kd6\" (UniqueName: \"kubernetes.io/projected/70b356e7-a809-4a2a-90b2-abf3a67dabed-kube-api-access-86kd6\") pod \"ingress-canary-qnzc2\" (UID: \"70b356e7-a809-4a2a-90b2-abf3a67dabed\") " pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:35.038145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.037802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.038145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.037841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f70d3d34-c676-42d0-973a-b6e0194e4536-config-volume\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.038145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.037887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f70d3d34-c676-42d0-973a-b6e0194e4536-tmp-dir\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.038473 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.038177 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f70d3d34-c676-42d0-973a-b6e0194e4536-tmp-dir\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.038473 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:35.038184 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:15:35.038473 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:35.038257 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:35.538238984 +0000 UTC m=+37.033263496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:15:35.038858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.038839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f70d3d34-c676-42d0-973a-b6e0194e4536-config-volume\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.042842 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.042824 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70b356e7-a809-4a2a-90b2-abf3a67dabed-cert\") pod \"ingress-canary-qnzc2\" (UID: \"70b356e7-a809-4a2a-90b2-abf3a67dabed\") " pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:35.046858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.046813 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2d6d\" (UniqueName: \"kubernetes.io/projected/f70d3d34-c676-42d0-973a-b6e0194e4536-kube-api-access-s2d6d\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.047022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.047000 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kd6\" (UniqueName: \"kubernetes.io/projected/70b356e7-a809-4a2a-90b2-abf3a67dabed-kube-api-access-86kd6\") pod \"ingress-canary-qnzc2\" (UID: \"70b356e7-a809-4a2a-90b2-abf3a67dabed\") " pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:35.155283 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.155237 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnzc2" Jul 07 02:15:35.541033 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.540992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:35.541224 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:35.541109 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:15:35.541224 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:35.541169 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:36.541149737 +0000 UTC m=+38.036174249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:15:35.566325 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.566288 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:35.624998 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:35.624960 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:36.036475 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.036290 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:15:36.036626 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.036301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:15:36.036698 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.036340 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:15:36.038971 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.038949 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 02:15:36.039271 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.038993 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 02:15:36.039271 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.038993 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 02:15:36.039470 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.039455 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92x5k\"" Jul 07 02:15:36.039516 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.039454 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 02:15:36.039555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.039530 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rj5t\"" Jul 07 02:15:36.129194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.129161 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnzc2"] Jul 07 02:15:36.172376 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:15:36.172344 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b356e7_a809_4a2a_90b2_abf3a67dabed.slice/crio-2194f85b87b3593bba826ee1e559fea956331f91dc450d8948d1e06850ff1778 WatchSource:0}: Error finding container 2194f85b87b3593bba826ee1e559fea956331f91dc450d8948d1e06850ff1778: Status 404 returned error can't find the container with id 2194f85b87b3593bba826ee1e559fea956331f91dc450d8948d1e06850ff1778 Jul 07 02:15:36.243743 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.243606 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnzc2" event={"ID":"70b356e7-a809-4a2a-90b2-abf3a67dabed","Type":"ContainerStarted","Data":"2194f85b87b3593bba826ee1e559fea956331f91dc450d8948d1e06850ff1778"} Jul 07 02:15:36.553236 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:36.553152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:36.553367 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:36.553308 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:15:36.553414 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:36.553376 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:38.553357511 +0000 UTC m=+40.048382033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:15:37.250073 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:37.250036 2556 generic.go:356] "Generic (PLEG): container finished" podID="9536b688-9423-45be-994c-38aa1697af9c" containerID="64482e567f9d5e3ce6d68aace290736ef6d421960acffaef8db3d6dcfcdfb312" exitCode=0 Jul 07 02:15:37.250592 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:37.250087 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerDied","Data":"64482e567f9d5e3ce6d68aace290736ef6d421960acffaef8db3d6dcfcdfb312"} Jul 07 02:15:38.256774 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:38.256529 2556 generic.go:356] "Generic (PLEG): container finished" podID="9536b688-9423-45be-994c-38aa1697af9c" containerID="07a0cab3238339406d20f6ef93ab976c1cc12a18ea925daf21c2d99efbe35d7b" exitCode=0 Jul 07 02:15:38.257134 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:38.256604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerDied","Data":"07a0cab3238339406d20f6ef93ab976c1cc12a18ea925daf21c2d99efbe35d7b"} Jul 07 02:15:38.571562 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:38.571465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:38.571748 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:38.571595 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:15:38.571748 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:38.571685 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:42.571663699 +0000 UTC m=+44.066688213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:15:39.264060 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:39.264025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-848sh" event={"ID":"9536b688-9423-45be-994c-38aa1697af9c","Type":"ContainerStarted","Data":"4b7de1757421adb45c2323f608ad53a913fdc58066e2fd4dcc38801fa1c93ce2"} Jul 07 02:15:39.288041 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:39.287959 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-848sh" podStartSLOduration=8.716479119 podStartE2EDuration="40.287944139s" totalImagesPullingTime="31.57146502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:39.286807626 +0000 UTC m=+40.781832147" watchObservedRunningTime="2026-07-07 02:15:39.287944139 +0000 UTC m=+40.782968670" Jul 07 02:15:39.289209 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:39.289137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:39.388377 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:39.388351 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:39.491481 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:39.491450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:39.590884 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:39.590813 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:40.267750 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:40.267709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnzc2" event={"ID":"70b356e7-a809-4a2a-90b2-abf3a67dabed","Type":"ContainerStarted","Data":"6de2b654dfd0409707aa2d95375571b950dc6f6a23b816f235d92616d5c88783"} Jul 07 02:15:40.283123 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:40.283070 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qnzc2" podStartSLOduration=3.087339854 podStartE2EDuration="6.283053132s" totalImagesPullingTime="3.195713278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:40.282701315 +0000 UTC m=+41.777725845" watchObservedRunningTime="2026-07-07 02:15:40.283053132 +0000 UTC m=+41.778077664" Jul 07 02:15:42.597203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:42.597164 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:42.597578 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:42.597301 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:15:42.597578 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:42.597386 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:50.597370824 +0000 UTC m=+52.092395334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:15:47.479285 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:47.479240 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:47.535287 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:47.535216 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:49.660591 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:49.660552 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:49.713444 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:49.713417 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:15:50.658553 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:15:50.658515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:15:50.658749 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:50.658627 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:15:50.658749 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:15:50.658711 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:06.658695785 +0000 UTC m=+68.153720293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:16:00.452055 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:00.452027 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvqzg" Jul 07 02:16:00.580080 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:00.580047 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:16:00.635901 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:00.635870 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:16:04.654293 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.654234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:16:04.654293 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.654308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:16:04.656449 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.656424 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 02:16:04.656655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.656623 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 02:16:04.664966 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:16:04.664938 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 02:16:04.665038 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:16:04.665025 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:08.665002401 +0000 UTC m=+130.160026931 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : secret "metrics-daemon-secret" not found Jul 07 02:16:04.669083 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.669060 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce55014-ddb8-4cd4-9652-b44f92053d6f-original-pull-secret\") pod \"global-pull-secret-syncer-qtjbj\" (UID: \"bce55014-ddb8-4cd4-9652-b44f92053d6f\") " pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:16:04.848373 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.848334 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtjbj" Jul 07 02:16:04.855491 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.855460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:16:04.857625 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.857606 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 02:16:04.868053 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.868025 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 02:16:04.879071 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.879039 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qshx\" (UniqueName: \"kubernetes.io/projected/19a5c7fa-1546-4354-83f7-6f114abe1007-kube-api-access-4qshx\") pod \"network-check-target-bcqjb\" (UID: \"19a5c7fa-1546-4354-83f7-6f114abe1007\") " pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:16:04.974861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:04.974814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qtjbj"] Jul 07 02:16:04.979813 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:16:04.979782 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce55014_ddb8_4cd4_9652_b44f92053d6f.slice/crio-7b26aa4b163e08f48b6a29a432ab922cf6b00dd3425ab666c5fb405365be31a6 WatchSource:0}: Error finding container 7b26aa4b163e08f48b6a29a432ab922cf6b00dd3425ab666c5fb405365be31a6: Status 404 returned error can't find the container with id 7b26aa4b163e08f48b6a29a432ab922cf6b00dd3425ab666c5fb405365be31a6 Jul 07 02:16:05.167915 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:05.167885 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rj5t\"" Jul 07 02:16:05.176309 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:05.176281 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:16:05.301209 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:05.301177 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bcqjb"] Jul 07 02:16:05.304441 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:16:05.304419 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5c7fa_1546_4354_83f7_6f114abe1007.slice/crio-eeeaec9013f63e490f88ac3dcb19d1fdf85e3137059ea9436bf6554b52382e6f WatchSource:0}: Error finding container eeeaec9013f63e490f88ac3dcb19d1fdf85e3137059ea9436bf6554b52382e6f: Status 404 returned error can't find the container with id eeeaec9013f63e490f88ac3dcb19d1fdf85e3137059ea9436bf6554b52382e6f Jul 07 02:16:05.324349 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:05.324318 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qtjbj" event={"ID":"bce55014-ddb8-4cd4-9652-b44f92053d6f","Type":"ContainerStarted","Data":"7b26aa4b163e08f48b6a29a432ab922cf6b00dd3425ab666c5fb405365be31a6"} Jul 07 02:16:05.325321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:05.325300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bcqjb" event={"ID":"19a5c7fa-1546-4354-83f7-6f114abe1007","Type":"ContainerStarted","Data":"eeeaec9013f63e490f88ac3dcb19d1fdf85e3137059ea9436bf6554b52382e6f"} Jul 07 02:16:06.670350 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:06.670307 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:16:06.670852 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:16:06.670462 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:16:06.670852 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:16:06.670534 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:38.670515604 +0000 UTC m=+100.165540132 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:16:10.342035 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:10.341998 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qtjbj" event={"ID":"bce55014-ddb8-4cd4-9652-b44f92053d6f","Type":"ContainerStarted","Data":"190edb507b1f13d3f40c1f81ba33ef302f79442bd843a059a6b5d5ce5459becb"} Jul 07 02:16:10.343593 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:10.343570 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bcqjb" event={"ID":"19a5c7fa-1546-4354-83f7-6f114abe1007","Type":"ContainerStarted","Data":"6c48c535e07f4bcb95c129dc021f268086eb59faa2ae077bf49037d19c88a8d4"} Jul 07 02:16:10.343711 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:10.343683 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:16:10.356254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:10.356200 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qtjbj" podStartSLOduration=66.567632189 podStartE2EDuration="1m11.35618182s" totalImagesPullingTime="4.788549631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:16:10.355807974 +0000 UTC m=+71.850832503" watchObservedRunningTime="2026-07-07 02:16:10.35618182 +0000 UTC m=+71.851206355" Jul 07 02:16:10.369153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:10.369100 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bcqjb" podStartSLOduration=66.909556453 podStartE2EDuration="1m11.369083927s" totalImagesPullingTime="4.459527474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:16:10.368492413 +0000 UTC m=+71.863516945" watchObservedRunningTime="2026-07-07 02:16:10.369083927 +0000 UTC m=+71.864108457" Jul 07 02:16:25.866067 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:25.866032 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:16:25.966525 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:25.966498 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:16:38.688601 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:38.688562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:16:38.689018 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:16:38.688727 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:16:38.689018 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:16:38.688807 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:42.688788606 +0000 UTC m=+164.183813120 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:16:41.349310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:16:41.349282 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bcqjb" Jul 07 02:17:08.687620 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:17:08.687568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:17:08.688121 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:17:08.687742 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 02:17:08.688121 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:17:08.687819 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:10.687803307 +0000 UTC m=+252.182827815 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : secret "metrics-daemon-secret" not found Jul 07 02:17:37.848859 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:17:37.848808 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mlkk2" podUID="f70d3d34-c676-42d0-973a-b6e0194e4536" Jul 07 02:17:38.551882 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:17:38.551852 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlkk2" Jul 07 02:17:39.057653 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:17:39.057598 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:17:42.717789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:17:42.717751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:17:42.718265 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:17:42.717863 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:17:42.718265 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:17:42.717914 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls podName:f70d3d34-c676-42d0-973a-b6e0194e4536 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:44.717901381 +0000 UTC m=+286.212925889 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls") pod "dns-default-mlkk2" (UID: "f70d3d34-c676-42d0-973a-b6e0194e4536") : secret "dns-default-metrics-tls" not found Jul 07 02:17:50.036755 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:17:50.036660 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:18:27.368044 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:18:27.368016 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:10.708324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:10.708277 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:19:10.708832 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:10.708441 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 02:19:10.708832 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:10.708508 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs podName:e6ba5b83-9449-46d8-b751-d001dc7bd041 nodeName:}" failed. No retries permitted until 2026-07-07 02:21:12.708490571 +0000 UTC m=+374.203515091 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs") pod "network-metrics-daemon-w2kkp" (UID: "e6ba5b83-9449-46d8-b751-d001dc7bd041") : secret "metrics-daemon-secret" not found Jul 07 02:19:15.915393 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.915352 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jds8q"] Jul 07 02:19:15.917190 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.917162 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6"] Jul 07 02:19:15.917311 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.917276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:15.918822 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.918802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" Jul 07 02:19:15.919732 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.919711 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 02:19:15.920056 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.920043 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 02:19:15.921027 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.920999 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 02:19:15.921334 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.921313 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5p2dc\"" Jul 07 02:19:15.921441 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.921351 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:19:15.921441 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.921320 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 02:19:15.921441 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.921315 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s5jxj\"" Jul 07 02:19:15.921441 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.921364 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:19:15.921746 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.921729 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6"] Jul 07 02:19:15.923694 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.923677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:15.925963 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.925944 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 02:19:15.926076 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.926059 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 02:19:15.926182 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.926164 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l7pzr\"" Jul 07 02:19:15.926250 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.926229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:19:15.929362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.929346 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 02:19:15.938363 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.938337 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6"] Jul 07 02:19:15.942749 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.942724 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6"] Jul 07 02:19:15.943612 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:15.943590 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jds8q"] Jul 07 02:19:16.014059 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.014027 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx"] Jul 07 02:19:16.016103 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.016086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.018504 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.018467 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 02:19:16.018733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.018506 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zz46w\"" Jul 07 02:19:16.018733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.018506 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 02:19:16.019073 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.018896 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 02:19:16.019322 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.019307 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 02:19:16.033850 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.033829 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx"] Jul 07 02:19:16.043424 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/920959fb-119c-48b0-a66b-6ccc6077c13b-config\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.043544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/920959fb-119c-48b0-a66b-6ccc6077c13b-trusted-ca\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.043544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xchrm\" (UniqueName: \"kubernetes.io/projected/c1a6d08f-ecfe-4438-8e13-4a95cd9109df-kube-api-access-xchrm\") pod \"volume-data-source-validator-5d456fdbcd-fgmt6\" (UID: \"c1a6d08f-ecfe-4438-8e13-4a95cd9109df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" Jul 07 02:19:16.043544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/920959fb-119c-48b0-a66b-6ccc6077c13b-serving-cert\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.043544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:16.043544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw785\" (UniqueName: \"kubernetes.io/projected/920959fb-119c-48b0-a66b-6ccc6077c13b-kube-api-access-rw785\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.043729 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.043568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6z4w\" (UniqueName: \"kubernetes.io/projected/d5844cbb-d8fa-4686-813b-8dc569eb6a14-kube-api-access-m6z4w\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:16.144223 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/920959fb-119c-48b0-a66b-6ccc6077c13b-trusted-ca\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.144223 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xchrm\" (UniqueName: \"kubernetes.io/projected/c1a6d08f-ecfe-4438-8e13-4a95cd9109df-kube-api-access-xchrm\") pod \"volume-data-source-validator-5d456fdbcd-fgmt6\" (UID: \"c1a6d08f-ecfe-4438-8e13-4a95cd9109df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/920959fb-119c-48b0-a66b-6ccc6077c13b-serving-cert\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw785\" (UniqueName: \"kubernetes.io/projected/920959fb-119c-48b0-a66b-6ccc6077c13b-kube-api-access-rw785\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k45xc\" (UniqueName: \"kubernetes.io/projected/d684618c-cf96-46c2-a898-e3f4fc8edd6a-kube-api-access-k45xc\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6z4w\" (UniqueName: \"kubernetes.io/projected/d5844cbb-d8fa-4686-813b-8dc569eb6a14-kube-api-access-m6z4w\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144406 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d684618c-cf96-46c2-a898-e3f4fc8edd6a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.144415 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.144462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.144465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/920959fb-119c-48b0-a66b-6ccc6077c13b-config\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.144815 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.144511 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls podName:d5844cbb-d8fa-4686-813b-8dc569eb6a14 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:16.644492829 +0000 UTC m=+258.139517345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fhsl6" (UID: "d5844cbb-d8fa-4686-813b-8dc569eb6a14") : secret "samples-operator-tls" not found Jul 07 02:19:16.145078 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.145060 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/920959fb-119c-48b0-a66b-6ccc6077c13b-config\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.145234 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.145216 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/920959fb-119c-48b0-a66b-6ccc6077c13b-trusted-ca\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.146808 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.146792 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/920959fb-119c-48b0-a66b-6ccc6077c13b-serving-cert\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.153160 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.153135 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6z4w\" (UniqueName: \"kubernetes.io/projected/d5844cbb-d8fa-4686-813b-8dc569eb6a14-kube-api-access-m6z4w\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:16.153288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.153231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xchrm\" (UniqueName: \"kubernetes.io/projected/c1a6d08f-ecfe-4438-8e13-4a95cd9109df-kube-api-access-xchrm\") pod \"volume-data-source-validator-5d456fdbcd-fgmt6\" (UID: \"c1a6d08f-ecfe-4438-8e13-4a95cd9109df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" Jul 07 02:19:16.153288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.153256 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw785\" (UniqueName: \"kubernetes.io/projected/920959fb-119c-48b0-a66b-6ccc6077c13b-kube-api-access-rw785\") pod \"console-operator-68b757fb67-jds8q\" (UID: \"920959fb-119c-48b0-a66b-6ccc6077c13b\") " pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.165693 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.165613 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:16.228529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.228501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:16.235110 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.235090 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" Jul 07 02:19:16.245338 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.245312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d684618c-cf96-46c2-a898-e3f4fc8edd6a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.245460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.245354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.245460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.245438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k45xc\" (UniqueName: \"kubernetes.io/projected/d684618c-cf96-46c2-a898-e3f4fc8edd6a-kube-api-access-k45xc\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.245566 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.245547 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:16.245668 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.245654 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls podName:d684618c-cf96-46c2-a898-e3f4fc8edd6a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:16.745616295 +0000 UTC m=+258.240640811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xdvtx" (UID: "d684618c-cf96-46c2-a898-e3f4fc8edd6a") : secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:16.246035 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.246013 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d684618c-cf96-46c2-a898-e3f4fc8edd6a-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.255567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.255530 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45xc\" (UniqueName: \"kubernetes.io/projected/d684618c-cf96-46c2-a898-e3f4fc8edd6a-kube-api-access-k45xc\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.267762 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.267727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:16.360073 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.360043 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jds8q"] Jul 07 02:19:16.364281 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:16.364254 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920959fb_119c_48b0_a66b_6ccc6077c13b.slice/crio-bf60639372dd3c14b82cdde58a416bf1f268ad5fdc3b8b52513eef9daee64673 WatchSource:0}: Error finding container bf60639372dd3c14b82cdde58a416bf1f268ad5fdc3b8b52513eef9daee64673: Status 404 returned error can't find the container with id bf60639372dd3c14b82cdde58a416bf1f268ad5fdc3b8b52513eef9daee64673 Jul 07 02:19:16.380314 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.380285 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6"] Jul 07 02:19:16.384096 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:16.384071 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a6d08f_ecfe_4438_8e13_4a95cd9109df.slice/crio-b8c49ae5b188b5cf370a25d97bf02c99b585f85eeb0b4ec0c538370f3216affb WatchSource:0}: Error finding container b8c49ae5b188b5cf370a25d97bf02c99b585f85eeb0b4ec0c538370f3216affb: Status 404 returned error can't find the container with id b8c49ae5b188b5cf370a25d97bf02c99b585f85eeb0b4ec0c538370f3216affb Jul 07 02:19:16.648876 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.648839 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:16.649041 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.648958 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:19:16.649041 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.649010 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls podName:d5844cbb-d8fa-4686-813b-8dc569eb6a14 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:17.648996223 +0000 UTC m=+259.144020732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fhsl6" (UID: "d5844cbb-d8fa-4686-813b-8dc569eb6a14") : secret "samples-operator-tls" not found Jul 07 02:19:16.749286 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.749250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:16.749458 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.749396 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:16.749498 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:16.749462 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls podName:d684618c-cf96-46c2-a898-e3f4fc8edd6a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:17.749447221 +0000 UTC m=+259.244471731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xdvtx" (UID: "d684618c-cf96-46c2-a898-e3f4fc8edd6a") : secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:16.785061 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.785023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" event={"ID":"920959fb-119c-48b0-a66b-6ccc6077c13b","Type":"ContainerStarted","Data":"bf60639372dd3c14b82cdde58a416bf1f268ad5fdc3b8b52513eef9daee64673"} Jul 07 02:19:16.785931 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:16.785910 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" event={"ID":"c1a6d08f-ecfe-4438-8e13-4a95cd9109df","Type":"ContainerStarted","Data":"b8c49ae5b188b5cf370a25d97bf02c99b585f85eeb0b4ec0c538370f3216affb"} Jul 07 02:19:17.656250 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:17.656211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:17.656720 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:17.656414 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:19:17.656720 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:17.656498 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls podName:d5844cbb-d8fa-4686-813b-8dc569eb6a14 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:19.656476467 +0000 UTC m=+261.151500979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fhsl6" (UID: "d5844cbb-d8fa-4686-813b-8dc569eb6a14") : secret "samples-operator-tls" not found Jul 07 02:19:17.756929 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:17.756843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:17.757106 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:17.756999 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:17.757106 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:17.757076 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls podName:d684618c-cf96-46c2-a898-e3f4fc8edd6a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:19.757055584 +0000 UTC m=+261.252080099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xdvtx" (UID: "d684618c-cf96-46c2-a898-e3f4fc8edd6a") : secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:17.789505 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:17.789465 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" event={"ID":"c1a6d08f-ecfe-4438-8e13-4a95cd9109df","Type":"ContainerStarted","Data":"5f9cb1e3fe054936897f6c27833cae0389e86c56782aa0d19eb756b5b68efc48"} Jul 07 02:19:17.803223 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:17.803170 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fgmt6" podStartSLOduration=1.69861167 podStartE2EDuration="2.803152527s" totalImagesPullingTime="1.104540857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:17.802515854 +0000 UTC m=+259.297540386" watchObservedRunningTime="2026-07-07 02:19:17.803152527 +0000 UTC m=+259.298177058" Jul 07 02:19:17.876737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:17.876702 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:17.933817 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:17.933781 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:18.795162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:18.795126 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/0.log" Jul 07 02:19:18.795551 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:18.795174 2556 generic.go:356] "Generic (PLEG): container finished" podID="920959fb-119c-48b0-a66b-6ccc6077c13b" containerID="40fb3e5d614614ac24c814c425c41bf31de8c971659de4e46c003eafa0281c47" exitCode=255 Jul 07 02:19:18.795551 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:18.795258 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" event={"ID":"920959fb-119c-48b0-a66b-6ccc6077c13b","Type":"ContainerDied","Data":"40fb3e5d614614ac24c814c425c41bf31de8c971659de4e46c003eafa0281c47"} Jul 07 02:19:18.795551 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:18.795472 2556 scope.go:117] "RemoveContainer" containerID="40fb3e5d614614ac24c814c425c41bf31de8c971659de4e46c003eafa0281c47" Jul 07 02:19:19.671244 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.671195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:19.671428 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:19.671347 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:19:19.671428 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:19.671418 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls podName:d5844cbb-d8fa-4686-813b-8dc569eb6a14 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.671400256 +0000 UTC m=+265.166424775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fhsl6" (UID: "d5844cbb-d8fa-4686-813b-8dc569eb6a14") : secret "samples-operator-tls" not found Jul 07 02:19:19.771825 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.771774 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:19.771958 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:19.771919 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:19.771996 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:19.771989 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls podName:d684618c-cf96-46c2-a898-e3f4fc8edd6a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.771974629 +0000 UTC m=+265.266999140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xdvtx" (UID: "d684618c-cf96-46c2-a898-e3f4fc8edd6a") : secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:19.798957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.798932 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:19:19.799326 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.799310 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/0.log" Jul 07 02:19:19.799365 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.799341 2556 generic.go:356] "Generic (PLEG): container finished" podID="920959fb-119c-48b0-a66b-6ccc6077c13b" containerID="83e93fca3ecd0fe34df09e76ec27466e690e5374330a1b5bfe22b76467eb5d9d" exitCode=255 Jul 07 02:19:19.799397 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.799375 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" event={"ID":"920959fb-119c-48b0-a66b-6ccc6077c13b","Type":"ContainerDied","Data":"83e93fca3ecd0fe34df09e76ec27466e690e5374330a1b5bfe22b76467eb5d9d"} Jul 07 02:19:19.799444 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.799432 2556 scope.go:117] "RemoveContainer" containerID="40fb3e5d614614ac24c814c425c41bf31de8c971659de4e46c003eafa0281c47" Jul 07 02:19:19.799605 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:19.799590 2556 scope.go:117] "RemoveContainer" containerID="83e93fca3ecd0fe34df09e76ec27466e690e5374330a1b5bfe22b76467eb5d9d" Jul 07 02:19:19.799785 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:19.799767 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jds8q_openshift-console-operator(920959fb-119c-48b0-a66b-6ccc6077c13b)\"" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" podUID="920959fb-119c-48b0-a66b-6ccc6077c13b" Jul 07 02:19:20.804225 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:20.804197 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:19:20.804655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:20.804486 2556 scope.go:117] "RemoveContainer" containerID="83e93fca3ecd0fe34df09e76ec27466e690e5374330a1b5bfe22b76467eb5d9d" Jul 07 02:19:20.804655 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:20.804625 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jds8q_openshift-console-operator(920959fb-119c-48b0-a66b-6ccc6077c13b)\"" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" podUID="920959fb-119c-48b0-a66b-6ccc6077c13b" Jul 07 02:19:21.040987 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.040954 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.105535 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.105441 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.334468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.334418 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.394630 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.394548 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6"] Jul 07 02:19:21.396988 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.396972 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" Jul 07 02:19:21.399153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.399129 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6fcgl\"" Jul 07 02:19:21.399567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.399553 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 02:19:21.399627 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.399602 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 02:19:21.408897 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.408871 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6"] Jul 07 02:19:21.438348 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.438314 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.484735 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.484699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jxz\" (UniqueName: \"kubernetes.io/projected/5315cbdc-c4f7-4d88-a973-2be17545c0de-kube-api-access-p2jxz\") pod \"migrator-d57d58cc9-fn8j6\" (UID: \"5315cbdc-c4f7-4d88-a973-2be17545c0de\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" Jul 07 02:19:21.537708 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.537673 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bzph6"] Jul 07 02:19:21.539672 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.539652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.543448 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.543424 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 02:19:21.543574 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.543527 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 02:19:21.543889 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.543874 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 02:19:21.543948 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.543879 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kcspv\"" Jul 07 02:19:21.544485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.544473 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 02:19:21.551362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.551341 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.566232 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.566203 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bzph6"] Jul 07 02:19:21.586577 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.586539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jxz\" (UniqueName: \"kubernetes.io/projected/5315cbdc-c4f7-4d88-a973-2be17545c0de-kube-api-access-p2jxz\") pod \"migrator-d57d58cc9-fn8j6\" (UID: \"5315cbdc-c4f7-4d88-a973-2be17545c0de\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" Jul 07 02:19:21.605306 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.605268 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jxz\" (UniqueName: \"kubernetes.io/projected/5315cbdc-c4f7-4d88-a973-2be17545c0de-kube-api-access-p2jxz\") pod \"migrator-d57d58cc9-fn8j6\" (UID: \"5315cbdc-c4f7-4d88-a973-2be17545c0de\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" Jul 07 02:19:21.675848 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.675760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.687045 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.687009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.687045 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.687046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zpj\" (UniqueName: \"kubernetes.io/projected/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-api-access-24zpj\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.687229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.687122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-data-volume\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.687229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.687163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.687229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.687188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-crio-socket\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.706181 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.706150 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" Jul 07 02:19:21.787942 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.787919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-crio-socket\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.788058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.788041 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.788132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.788061 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-crio-socket\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.788132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.788074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24zpj\" (UniqueName: \"kubernetes.io/projected/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-api-access-24zpj\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.788229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.788129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-data-volume\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.788229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.788163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.788229 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:21.788179 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:19:21.788363 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:21.788241 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:22.288218891 +0000 UTC m=+263.783243414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : secret "insights-runtime-extractor-tls" not found Jul 07 02:19:21.788363 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:21.788252 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:19:21.788363 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:21.788308 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:22.288290996 +0000 UTC m=+263.783315507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : configmap "kube-rbac-proxy" not found Jul 07 02:19:21.788746 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.788703 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-data-volume\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.797266 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.797241 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zpj\" (UniqueName: \"kubernetes.io/projected/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-api-access-24zpj\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:21.807047 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.807019 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.840337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:21.840302 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6"] Jul 07 02:19:21.845143 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:21.845119 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5315cbdc_c4f7_4d88_a973_2be17545c0de.slice/crio-cc3b410192359a51c03e9c99649010fd84e53d91db8154c8a533ef25e8b62501 WatchSource:0}: Error finding container cc3b410192359a51c03e9c99649010fd84e53d91db8154c8a533ef25e8b62501: Status 404 returned error can't find the container with id cc3b410192359a51c03e9c99649010fd84e53d91db8154c8a533ef25e8b62501 Jul 07 02:19:22.291565 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:22.291519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:22.291565 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:22.291583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:22.291832 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:22.291676 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:19:22.291832 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:22.291715 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:19:22.291832 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:22.291724 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.291710548 +0000 UTC m=+264.786735057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : configmap "kube-rbac-proxy" not found Jul 07 02:19:22.291934 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:22.291839 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.29182268 +0000 UTC m=+264.786847193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : secret "insights-runtime-extractor-tls" not found Jul 07 02:19:22.811791 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:22.811759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" event={"ID":"5315cbdc-c4f7-4d88-a973-2be17545c0de","Type":"ContainerStarted","Data":"cc3b410192359a51c03e9c99649010fd84e53d91db8154c8a533ef25e8b62501"} Jul 07 02:19:23.297946 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.297910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:23.298146 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.297975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:23.298146 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.298050 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:19:23.298146 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.298068 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:19:23.298146 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.298122 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:25.298107152 +0000 UTC m=+266.793131661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : secret "insights-runtime-extractor-tls" not found Jul 07 02:19:23.298146 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.298137 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:25.298130613 +0000 UTC m=+266.793155123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : configmap "kube-rbac-proxy" not found Jul 07 02:19:23.379430 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.379322 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:23.451562 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.451532 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:23.700852 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.700762 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:23.700978 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.700903 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:19:23.700978 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.700965 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls podName:d5844cbb-d8fa-4686-813b-8dc569eb6a14 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.700949888 +0000 UTC m=+273.195974402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fhsl6" (UID: "d5844cbb-d8fa-4686-813b-8dc569eb6a14") : secret "samples-operator-tls" not found Jul 07 02:19:23.801310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.801268 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:23.801441 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.801391 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:23.801506 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:23.801448 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls podName:d684618c-cf96-46c2-a898-e3f4fc8edd6a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.801430655 +0000 UTC m=+273.296455164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xdvtx" (UID: "d684618c-cf96-46c2-a898-e3f4fc8edd6a") : secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:23.816108 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.816072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" event={"ID":"5315cbdc-c4f7-4d88-a973-2be17545c0de","Type":"ContainerStarted","Data":"f89ba12e806b60b80b3cd75eba096bb477a4d09ca066ec373cae013b55125592"} Jul 07 02:19:23.816426 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.816126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" event={"ID":"5315cbdc-c4f7-4d88-a973-2be17545c0de","Type":"ContainerStarted","Data":"733331cf8e0a1dc1303096cdcf07067235ecd4df664ab5ef63610e9482ce2217"} Jul 07 02:19:23.833537 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.833490 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fn8j6" podStartSLOduration=1.590395307 podStartE2EDuration="2.8334763s" totalImagesPullingTime="1.243080993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:23.832972375 +0000 UTC m=+265.327996907" watchObservedRunningTime="2026-07-07 02:19:23.8334763 +0000 UTC m=+265.328500860" Jul 07 02:19:23.941254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:23.941224 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.066132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:24.066090 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.114514 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:24.114491 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cdthv_63a30a0d-2d40-4d25-9446-8396ef1c1a36/dns-node-resolver/0.log" Jul 07 02:19:24.415232 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:24.415153 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.877985 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:24.877955 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.982927 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:24.982891 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:25.214933 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:25.214904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:25.309856 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:25.309828 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:25.313868 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:25.313851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:25.313956 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:25.313893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:25.314021 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:25.314010 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:19:25.314077 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:25.314021 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:19:25.314077 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:25.314064 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:29.31404943 +0000 UTC m=+270.809073941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : configmap "kube-rbac-proxy" not found Jul 07 02:19:25.314077 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:25.314078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:29.314072167 +0000 UTC m=+270.809096675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : secret "insights-runtime-extractor-tls" not found Jul 07 02:19:25.505876 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:25.505806 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hk8cw_f3b765d1-889d-4154-9f56-408bd962bbd4/node-ca/0.log" Jul 07 02:19:25.577914 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:25.577872 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:26.228870 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.228838 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:26.229335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.228894 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:26.229335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.229282 2556 scope.go:117] "RemoveContainer" containerID="83e93fca3ecd0fe34df09e76ec27466e690e5374330a1b5bfe22b76467eb5d9d" Jul 07 02:19:26.229492 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:26.229469 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jds8q_openshift-console-operator(920959fb-119c-48b0-a66b-6ccc6077c13b)\"" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" podUID="920959fb-119c-48b0-a66b-6ccc6077c13b" Jul 07 02:19:26.306620 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.306592 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnzc2_70b356e7-a809-4a2a-90b2-abf3a67dabed/serve-healthcheck-canary/0.log" Jul 07 02:19:26.502819 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.502698 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fn8j6_5315cbdc-c4f7-4d88-a973-2be17545c0de/migrator/0.log" Jul 07 02:19:26.549229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.549200 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:26.702957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:26.702930 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fn8j6_5315cbdc-c4f7-4d88-a973-2be17545c0de/graceful-termination/0.log" Jul 07 02:19:27.718136 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:27.718097 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:28.120367 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:28.120255 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:28.395243 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:28.395119 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:28.731053 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:28.731021 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:28.795609 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:28.795576 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:28.939879 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:28.939824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:29.123819 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:29.123719 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:29.326973 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:29.326941 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:29.344233 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:29.344204 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:29.344382 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:29.344248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:29.344382 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:29.344350 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:19:29.344382 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:29.344349 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:19:29.344498 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:29.344407 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:37.344390483 +0000 UTC m=+278.839414997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : configmap "kube-rbac-proxy" not found Jul 07 02:19:29.344498 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:29.344420 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls podName:e9a5a71c-a1e8-4c59-b3a6-1186d4202d93 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:37.3444145 +0000 UTC m=+278.839439009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bzph6" (UID: "e9a5a71c-a1e8-4c59-b3a6-1186d4202d93") : secret "insights-runtime-extractor-tls" not found Jul 07 02:19:29.558460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:29.558408 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:30.527724 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:30.527692 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:30.947831 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:30.947740 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:31.127915 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.127876 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:31.327371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.327341 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:31.391096 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.391067 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:31.724555 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.724529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:31.763741 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.763703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:31.766167 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.766138 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5844cbb-d8fa-4686-813b-8dc569eb6a14-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fhsl6\" (UID: \"d5844cbb-d8fa-4686-813b-8dc569eb6a14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:31.841314 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.841289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" Jul 07 02:19:31.864866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.864831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:31.865048 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:31.864963 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:31.865048 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:31.865022 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls podName:d684618c-cf96-46c2-a898-e3f4fc8edd6a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:47.865008624 +0000 UTC m=+289.360033133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xdvtx" (UID: "d684618c-cf96-46c2-a898-e3f4fc8edd6a") : secret "cluster-monitoring-operator-tls" not found Jul 07 02:19:31.971188 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:31.971158 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6"] Jul 07 02:19:32.127503 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:32.127463 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:32.731064 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:32.731028 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:32.844575 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:32.844543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" event={"ID":"d5844cbb-d8fa-4686-813b-8dc569eb6a14","Type":"ContainerStarted","Data":"4529cfb1795b226defbbe6a222620cdc367c3f0aa5b5f4a9b31d129badfbd7df"} Jul 07 02:19:33.121290 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:33.121210 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:33.321627 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:33.321590 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:33.729552 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:33.729519 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:33.848858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:33.848765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" event={"ID":"d5844cbb-d8fa-4686-813b-8dc569eb6a14","Type":"ContainerStarted","Data":"7f5304cb70b37aedb8303d276276629d5760ff68f978f737d3cdad575540e65e"} Jul 07 02:19:33.848858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:33.848838 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" event={"ID":"d5844cbb-d8fa-4686-813b-8dc569eb6a14","Type":"ContainerStarted","Data":"1d17886dbd0e8b080a82f67e2efc6e2888d722f8c308a4fcf4ecc1f9111ee24f"} Jul 07 02:19:33.863910 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:33.863858 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fhsl6" podStartSLOduration=17.335313251 podStartE2EDuration="18.863840487s" totalImagesPullingTime="1.528527236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:33.863150868 +0000 UTC m=+275.358175401" watchObservedRunningTime="2026-07-07 02:19:33.863840487 +0000 UTC m=+275.358865017" Jul 07 02:19:34.499691 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:34.499652 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:34.562678 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:34.562622 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:34.724171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:34.724137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:34.924337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:34.924261 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:35.125684 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:35.125654 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:35.528231 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:35.528199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:36.217062 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:36.217030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:37.409712 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.409674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:37.410130 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.409723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:37.410222 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.410202 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:37.412098 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.412079 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a5a71c-a1e8-4c59-b3a6-1186d4202d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bzph6\" (UID: \"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93\") " pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:37.448310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.448285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bzph6" Jul 07 02:19:37.592347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.592315 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bzph6"] Jul 07 02:19:37.596100 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:37.596068 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a5a71c_a1e8_4c59_b3a6_1186d4202d93.slice/crio-10a03e1a4b75436c422ce12699bf3535aec29ab53e1e0cdc175b79eba95b63e9 WatchSource:0}: Error finding container 10a03e1a4b75436c422ce12699bf3535aec29ab53e1e0cdc175b79eba95b63e9: Status 404 returned error can't find the container with id 10a03e1a4b75436c422ce12699bf3535aec29ab53e1e0cdc175b79eba95b63e9 Jul 07 02:19:37.861617 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:37.861583 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzph6" event={"ID":"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93","Type":"ContainerStarted","Data":"10a03e1a4b75436c422ce12699bf3535aec29ab53e1e0cdc175b79eba95b63e9"} Jul 07 02:19:40.036849 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:40.036812 2556 scope.go:117] "RemoveContainer" containerID="83e93fca3ecd0fe34df09e76ec27466e690e5374330a1b5bfe22b76467eb5d9d" Jul 07 02:19:41.552872 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:41.552777 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mlkk2" podUID="f70d3d34-c676-42d0-973a-b6e0194e4536" Jul 07 02:19:41.875362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:41.875316 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzph6" event={"ID":"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93","Type":"ContainerStarted","Data":"2fefb79e0f8e1ee45afac9eb29c38f2aae0531d4d01e75829d4fd366b2d488c2"} Jul 07 02:19:41.876984 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:41.876968 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:19:41.877068 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:41.877058 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlkk2" Jul 07 02:19:41.877104 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:41.877076 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" event={"ID":"920959fb-119c-48b0-a66b-6ccc6077c13b","Type":"ContainerStarted","Data":"8e5f8c8e53c2c10bcfbe1a48dc9161234e877f8b4912f1c6f07ebb7e17cf0910"} Jul 07 02:19:41.877363 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:41.877336 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:41.891975 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:41.891843 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" podStartSLOduration=24.834062138 podStartE2EDuration="26.891822389s" totalImagesPullingTime="2.057760251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:41.891410375 +0000 UTC m=+283.386434909" watchObservedRunningTime="2026-07-07 02:19:41.891822389 +0000 UTC m=+283.386846916" Jul 07 02:19:42.788369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:42.788336 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-jds8q" Jul 07 02:19:42.883052 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:42.883016 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzph6" event={"ID":"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93","Type":"ContainerStarted","Data":"b47bdf2a36a415d5c1e5aa46b61487197834a002297008dfc85650ed15b15368"} Jul 07 02:19:42.962684 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:42.962621 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.063418 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.063337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.118531 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.118495 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.454377 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.454277 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-wzggb"] Jul 07 02:19:43.458866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.458843 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:19:43.461413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.461376 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 02:19:43.466904 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.466882 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jbgdn\"" Jul 07 02:19:43.467732 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.467711 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 02:19:43.494775 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.494744 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-wzggb"] Jul 07 02:19:43.529812 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.529776 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c946f6d5c-x9wpr"] Jul 07 02:19:43.533102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.533076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.533594 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.533567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.535018 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.534996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 02:19:43.535170 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.535153 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pv7ql\"" Jul 07 02:19:43.535883 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.535864 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 02:19:43.535976 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.535889 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 02:19:43.542807 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.542783 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 02:19:43.546839 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.546816 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c946f6d5c-x9wpr"] Jul 07 02:19:43.558880 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.558844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6khv\" (UniqueName: \"kubernetes.io/projected/3debe371-0ff2-432e-8813-8bf61cadd474-kube-api-access-j6khv\") pod \"downloads-685bfb5f64-wzggb\" (UID: \"3debe371-0ff2-432e-8813-8bf61cadd474\") " pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:19:43.623439 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.623400 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.659310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659261 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-trusted-ca\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6khv\" (UniqueName: \"kubernetes.io/projected/3debe371-0ff2-432e-8813-8bf61cadd474-kube-api-access-j6khv\") pod \"downloads-685bfb5f64-wzggb\" (UID: \"3debe371-0ff2-432e-8813-8bf61cadd474\") " pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:19:43.659530 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-ca-trust-extracted\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659530 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-image-registry-private-configuration\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659628 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659546 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-installation-pull-secrets\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659628 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-bound-sa-token\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659752 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wdg7\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-kube-api-access-6wdg7\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659802 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-registry-tls\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.659850 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.659806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-registry-certificates\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.670982 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.670954 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6khv\" (UniqueName: \"kubernetes.io/projected/3debe371-0ff2-432e-8813-8bf61cadd474-kube-api-access-j6khv\") pod \"downloads-685bfb5f64-wzggb\" (UID: \"3debe371-0ff2-432e-8813-8bf61cadd474\") " pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:19:43.760586 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wdg7\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-kube-api-access-6wdg7\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760783 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-registry-tls\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760783 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760651 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-registry-certificates\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760783 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760734 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-trusted-ca\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760783 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760774 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-ca-trust-extracted\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760978 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760824 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-image-registry-private-configuration\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760978 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-installation-pull-secrets\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.760978 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.760883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-bound-sa-token\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.761394 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.761361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-ca-trust-extracted\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.761893 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.761695 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-registry-certificates\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.762002 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.761895 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-trusted-ca\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.763953 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.763934 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-registry-tls\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.763953 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.763946 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-installation-pull-secrets\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.764081 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.764041 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-image-registry-private-configuration\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.769221 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.769198 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-bound-sa-token\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.769321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.769293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:19:43.769421 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.769399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wdg7\" (UniqueName: \"kubernetes.io/projected/4b70dad6-4b57-4e74-a3ad-7da8de00fa0c-kube-api-access-6wdg7\") pod \"image-registry-6c946f6d5c-x9wpr\" (UID: \"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c\") " pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.844865 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.844834 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:43.857760 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.857720 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.921214 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.921178 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:43.987295 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:43.987264 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:44.088070 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.088000 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:44.612696 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.612668 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c946f6d5c-x9wpr"] Jul 07 02:19:44.615967 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:44.615944 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b70dad6_4b57_4e74_a3ad_7da8de00fa0c.slice/crio-e5c1854024ea10b0994e9213d442ce9d7521fdb43d06f50a3d4313213d06054a WatchSource:0}: Error finding container e5c1854024ea10b0994e9213d442ce9d7521fdb43d06f50a3d4313213d06054a: Status 404 returned error can't find the container with id e5c1854024ea10b0994e9213d442ce9d7521fdb43d06f50a3d4313213d06054a Jul 07 02:19:44.621683 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.621591 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-wzggb"] Jul 07 02:19:44.627465 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:44.627435 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3debe371_0ff2_432e_8813_8bf61cadd474.slice/crio-394bf5575631c5a51c6e2fb27d429c011a0b208116eb874cca8ea6f35a8d1f27 WatchSource:0}: Error finding container 394bf5575631c5a51c6e2fb27d429c011a0b208116eb874cca8ea6f35a8d1f27: Status 404 returned error can't find the container with id 394bf5575631c5a51c6e2fb27d429c011a0b208116eb874cca8ea6f35a8d1f27 Jul 07 02:19:44.669897 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.669873 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:44.770959 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.770877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:19:44.773311 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.773291 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70d3d34-c676-42d0-973a-b6e0194e4536-metrics-tls\") pod \"dns-default-mlkk2\" (UID: \"f70d3d34-c676-42d0-973a-b6e0194e4536\") " pod="openshift-dns/dns-default-mlkk2" Jul 07 02:19:44.854786 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.854755 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:44.879574 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.879544 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nr4jk\"" Jul 07 02:19:44.887886 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.887864 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlkk2" Jul 07 02:19:44.891164 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.890933 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-wzggb" event={"ID":"3debe371-0ff2-432e-8813-8bf61cadd474","Type":"ContainerStarted","Data":"394bf5575631c5a51c6e2fb27d429c011a0b208116eb874cca8ea6f35a8d1f27"} Jul 07 02:19:44.892993 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.892971 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bzph6" event={"ID":"e9a5a71c-a1e8-4c59-b3a6-1186d4202d93","Type":"ContainerStarted","Data":"787c02af7f61c75fc003545c0267b4fc89468b5601f23dedfd9225cd5de481b8"} Jul 07 02:19:44.894461 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.894440 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" event={"ID":"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c","Type":"ContainerStarted","Data":"7a1fd4dcaab18a1a068253c97b13683913fbbf5877160510c5a019e9c3adc21c"} Jul 07 02:19:44.894586 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.894472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" event={"ID":"4b70dad6-4b57-4e74-a3ad-7da8de00fa0c","Type":"ContainerStarted","Data":"e5c1854024ea10b0994e9213d442ce9d7521fdb43d06f50a3d4313213d06054a"} Jul 07 02:19:44.894676 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.894587 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:19:44.908508 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.908430 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bzph6" podStartSLOduration=17.126325827 podStartE2EDuration="23.90840808s" totalImagesPullingTime="6.782082253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:19:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:44.907992658 +0000 UTC m=+286.403017191" watchObservedRunningTime="2026-07-07 02:19:44.90840808 +0000 UTC m=+286.403432610" Jul 07 02:19:44.926408 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:44.926341 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" podStartSLOduration=1.9263186509999999 podStartE2EDuration="1.926318651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:44.925789378 +0000 UTC m=+286.420813908" watchObservedRunningTime="2026-07-07 02:19:44.926318651 +0000 UTC m=+286.421343184" Jul 07 02:19:45.046917 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:45.046837 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mlkk2"] Jul 07 02:19:45.049981 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:19:45.049951 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70d3d34_c676_42d0_973a_b6e0194e4536.slice/crio-2b4767f0a6826e4c4aef56d2f2ea7e341c6628b8971be2501f9df728f8fea218 WatchSource:0}: Error finding container 2b4767f0a6826e4c4aef56d2f2ea7e341c6628b8971be2501f9df728f8fea218: Status 404 returned error can't find the container with id 2b4767f0a6826e4c4aef56d2f2ea7e341c6628b8971be2501f9df728f8fea218 Jul 07 02:19:45.338339 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:45.338251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:45.875792 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:45.875748 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:45.900019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:45.899982 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlkk2" event={"ID":"f70d3d34-c676-42d0-973a-b6e0194e4536","Type":"ContainerStarted","Data":"2b4767f0a6826e4c4aef56d2f2ea7e341c6628b8971be2501f9df728f8fea218"} Jul 07 02:19:45.931289 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:45.931251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:46.906483 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:46.906448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlkk2" event={"ID":"f70d3d34-c676-42d0-973a-b6e0194e4536","Type":"ContainerStarted","Data":"26931ed8d6651c72e6061e4a96a7b0ba7832f406eff54c255967981ab069d1fd"} Jul 07 02:19:47.896869 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:47.896832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:47.899764 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:47.899739 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d684618c-cf96-46c2-a898-e3f4fc8edd6a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xdvtx\" (UID: \"d684618c-cf96-46c2-a898-e3f4fc8edd6a\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:47.914318 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:47.914275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlkk2" event={"ID":"f70d3d34-c676-42d0-973a-b6e0194e4536","Type":"ContainerStarted","Data":"5b60e67ab06fb18727a30b4505a9d48cbab6d70146973105cd2df5bd85609982"} Jul 07 02:19:47.914782 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:47.914363 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mlkk2" Jul 07 02:19:47.932247 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:47.932186 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mlkk2" podStartSLOduration=252.276128518 podStartE2EDuration="4m13.932164061s" totalImagesPullingTime="1.656035543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:47.931660301 +0000 UTC m=+289.426684829" watchObservedRunningTime="2026-07-07 02:19:47.932164061 +0000 UTC m=+289.427188594" Jul 07 02:19:48.125284 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:48.125246 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" Jul 07 02:19:48.287539 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:48.287419 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx"] Jul 07 02:19:48.919492 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:48.919450 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" event={"ID":"d684618c-cf96-46c2-a898-e3f4fc8edd6a","Type":"ContainerStarted","Data":"15f2f256d27f8577bccdcb627c9e02424f54f325a59c4021b8a1fe223e445caa"} Jul 07 02:19:49.438750 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:49.438712 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:49.501175 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:49.501134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.543278 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:50.543236 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.643840 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:50.643806 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.710424 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:50.710371 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.775056 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:50.775023 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.928568 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:50.928473 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" event={"ID":"d684618c-cf96-46c2-a898-e3f4fc8edd6a","Type":"ContainerStarted","Data":"ea67351b585fcdce6056fda480c45e5b9d23d21457a0554a851da5b4cd049a6f"} Jul 07 02:19:50.943058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:50.942996 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xdvtx" podStartSLOduration=34.044437679 podStartE2EDuration="35.942979618s" totalImagesPullingTime="1.898541939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:50.94209851 +0000 UTC m=+292.437123040" watchObservedRunningTime="2026-07-07 02:19:50.942979618 +0000 UTC m=+292.438004140" Jul 07 02:19:53.037150 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:53.037106 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w2kkp" podUID="e6ba5b83-9449-46d8-b751-d001dc7bd041" Jul 07 02:19:53.736508 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.736461 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:53.775355 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.775312 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t"] Jul 07 02:19:53.778869 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.778833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.781241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.781212 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 02:19:53.781241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.781235 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 02:19:53.781695 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.781671 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dls29\"" Jul 07 02:19:53.781799 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.781774 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 02:19:53.786503 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.786422 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t"] Jul 07 02:19:53.802422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.802340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:53.847132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.847099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.847313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.847159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/388a21ba-3221-444a-a99e-57f9e6231ef6-kube-api-access-ldbrb\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.847313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.847237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.847313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.847269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388a21ba-3221-444a-a99e-57f9e6231ef6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.948138 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.948102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/388a21ba-3221-444a-a99e-57f9e6231ef6-kube-api-access-ldbrb\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.948337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.948183 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.948337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.948211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388a21ba-3221-444a-a99e-57f9e6231ef6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.948539 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.948508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.948697 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:53.948597 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 02:19:53.948697 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:19:53.948676 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-tls podName:388a21ba-3221-444a-a99e-57f9e6231ef6 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:54.448658934 +0000 UTC m=+295.943683451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-cl45t" (UID: "388a21ba-3221-444a-a99e-57f9e6231ef6") : secret "prometheus-operator-tls" not found Jul 07 02:19:53.949017 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.948956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/388a21ba-3221-444a-a99e-57f9e6231ef6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.950852 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.950830 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:53.956680 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:53.956657 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbrb\" (UniqueName: \"kubernetes.io/projected/388a21ba-3221-444a-a99e-57f9e6231ef6-kube-api-access-ldbrb\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:54.129354 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.129260 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.266421 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.266340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.324588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.324560 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.452902 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.452816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:54.455709 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.455682 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/388a21ba-3221-444a-a99e-57f9e6231ef6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-cl45t\" (UID: \"388a21ba-3221-444a-a99e-57f9e6231ef6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:54.458764 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.458740 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.516677 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.516623 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.690757 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:54.690728 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" Jul 07 02:19:55.506215 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.506176 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9646f9b6-56fmv"] Jul 07 02:19:55.509686 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.509663 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.511961 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.511839 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 02:19:55.512277 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.512250 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:55.512436 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.512283 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 02:19:55.512436 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.512288 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 02:19:55.512436 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.512352 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6hjz\"" Jul 07 02:19:55.512593 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.512571 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 02:19:55.512749 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.512574 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 02:19:55.516833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.516809 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 02:19:55.519371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.519350 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9646f9b6-56fmv"] Jul 07 02:19:55.563062 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-trusted-ca-bundle\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.563258 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-oauth-serving-cert\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.563258 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-config\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.563258 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twwj\" (UniqueName: \"kubernetes.io/projected/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-kube-api-access-4twwj\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.563258 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-serving-cert\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.563447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-service-ca\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.563447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.563287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-oauth-config\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.571020 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.570977 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:55.663935 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.663890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-serving-cert\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.663935 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.663940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-service-ca\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.664184 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.664067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-oauth-config\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.664184 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.664152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-trusted-ca-bundle\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.664286 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.664196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-oauth-serving-cert\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.664286 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.664250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-config\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.664444 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.664290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twwj\" (UniqueName: \"kubernetes.io/projected/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-kube-api-access-4twwj\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.664835 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.664775 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-service-ca\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.665119 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.665022 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-trusted-ca-bundle\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.665305 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.665280 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-config\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.665402 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.665360 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-oauth-serving-cert\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.667056 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.667034 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-serving-cert\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.667514 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.667489 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-oauth-config\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.672308 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.672283 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twwj\" (UniqueName: \"kubernetes.io/projected/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-kube-api-access-4twwj\") pod \"console-7f9646f9b6-56fmv\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.822783 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.822657 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:19:55.875074 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:55.875035 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:56.929752 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:56.929709 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:56.985956 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:56.985915 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:57.922135 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:57.922104 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mlkk2" Jul 07 02:19:58.040248 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:58.040214 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:58.142056 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:58.142018 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:58.912827 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:58.912794 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:58.965523 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:19:58.965485 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:01.758214 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.758187 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:20:01.758811 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.758790 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:20:01.763091 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.763069 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:20:01.763596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.763566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:20:01.770950 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.770920 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 02:20:01.899319 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.899175 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t"] Jul 07 02:20:01.902444 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:01.902415 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388a21ba_3221_444a_a99e_57f9e6231ef6.slice/crio-32bb243603112b34a8f3917f2b001bcccb85a0af2d43d2f4bcd8b7fc2f669c2f WatchSource:0}: Error finding container 32bb243603112b34a8f3917f2b001bcccb85a0af2d43d2f4bcd8b7fc2f669c2f: Status 404 returned error can't find the container with id 32bb243603112b34a8f3917f2b001bcccb85a0af2d43d2f4bcd8b7fc2f669c2f Jul 07 02:20:01.904725 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.904677 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:20:01.914195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.913245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9646f9b6-56fmv"] Jul 07 02:20:01.920061 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:01.920035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d07d10_ba3d_424f_b6d4_6b915c4b88b5.slice/crio-61e7c4515ee5f5a9576eecd5f2870c4da950c7eb5f9038e314d71de9e1ee762d WatchSource:0}: Error finding container 61e7c4515ee5f5a9576eecd5f2870c4da950c7eb5f9038e314d71de9e1ee762d: Status 404 returned error can't find the container with id 61e7c4515ee5f5a9576eecd5f2870c4da950c7eb5f9038e314d71de9e1ee762d Jul 07 02:20:01.971418 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.971370 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9646f9b6-56fmv" event={"ID":"92d07d10-ba3d-424f-b6d4-6b915c4b88b5","Type":"ContainerStarted","Data":"61e7c4515ee5f5a9576eecd5f2870c4da950c7eb5f9038e314d71de9e1ee762d"} Jul 07 02:20:01.972541 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.972449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" event={"ID":"388a21ba-3221-444a-a99e-57f9e6231ef6","Type":"ContainerStarted","Data":"32bb243603112b34a8f3917f2b001bcccb85a0af2d43d2f4bcd8b7fc2f669c2f"} Jul 07 02:20:01.973981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.973956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-wzggb" event={"ID":"3debe371-0ff2-432e-8813-8bf61cadd474","Type":"ContainerStarted","Data":"63f93261aee261c728a93f111911c39ac065074c8600dcfc82e111cac256e353"} Jul 07 02:20:01.974203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.974174 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:20:01.975611 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.975585 2556 patch_prober.go:28] interesting pod/downloads-685bfb5f64-wzggb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Jul 07 02:20:01.975732 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.975628 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-wzggb" podUID="3debe371-0ff2-432e-8813-8bf61cadd474" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Jul 07 02:20:01.995603 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:01.995485 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-wzggb" podStartSLOduration=1.788710987 podStartE2EDuration="18.995466624s" totalImagesPullingTime="17.206755637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:01.994774974 +0000 UTC m=+303.489799506" watchObservedRunningTime="2026-07-07 02:20:01.995466624 +0000 UTC m=+303.490491154" Jul 07 02:20:02.993424 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:02.993389 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-wzggb" Jul 07 02:20:03.087884 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:03.087726 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:04.174695 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:04.174658 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:04.275319 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:04.275274 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:05.905713 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:05.905684 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c946f6d5c-x9wpr" Jul 07 02:20:06.009665 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:06.003033 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" event={"ID":"388a21ba-3221-444a-a99e-57f9e6231ef6","Type":"ContainerStarted","Data":"7fdb3a8fd5f0c001fea1312e2a3d14078edf049010cc93dae4fcfb7312854f38"} Jul 07 02:20:06.032916 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:06.032884 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:06.132696 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:06.132664 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:06.237497 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:06.237459 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:06.338463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:06.338376 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:07.009939 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:07.009902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" event={"ID":"388a21ba-3221-444a-a99e-57f9e6231ef6","Type":"ContainerStarted","Data":"f7a15dc7364f81b7e30f5093ca30f26077d69db245bfcacf9e71ad28578a8edb"} Jul 07 02:20:07.011770 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:07.011740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9646f9b6-56fmv" event={"ID":"92d07d10-ba3d-424f-b6d4-6b915c4b88b5","Type":"ContainerStarted","Data":"368709f4c7604bab8e349e8640c85357bc14c521d32fb3a3b3048ffe1c13a5e9"} Jul 07 02:20:07.029657 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:07.029570 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-cl45t" podStartSLOduration=10.225982355 podStartE2EDuration="14.029546513s" totalImagesPullingTime="3.803564158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:07.028516933 +0000 UTC m=+308.523541478" watchObservedRunningTime="2026-07-07 02:20:07.029546513 +0000 UTC m=+308.524571045" Jul 07 02:20:07.035990 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:07.035959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:20:07.049502 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:07.049448 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9646f9b6-56fmv" podStartSLOduration=7.913384092 podStartE2EDuration="12.049430167s" totalImagesPullingTime="4.136046075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:07.048728695 +0000 UTC m=+308.543753227" watchObservedRunningTime="2026-07-07 02:20:07.049430167 +0000 UTC m=+308.544454698" Jul 07 02:20:08.880511 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:08.880469 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.064903 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.064855 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.142597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.142497 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rnbdf"] Jul 07 02:20:09.156289 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.156243 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.217754 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.217716 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.220757 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.220734 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 02:20:09.221704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.221680 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 02:20:09.221830 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.221687 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9dhbd\"" Jul 07 02:20:09.222133 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.222116 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 02:20:09.259453 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.259414 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.291170 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-wtmp\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-tls\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-sys\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1210f72a-313a-44d1-ba20-f75fe65c14cd-metrics-client-ca\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-root\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291335 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-textfile\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291675 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvgw8\" (UniqueName: \"kubernetes.io/projected/1210f72a-313a-44d1-ba20-f75fe65c14cd-kube-api-access-qvgw8\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.291675 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.291392 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.320448 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.320404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.390273 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.390242 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.392348 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-sys\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392476 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1210f72a-313a-44d1-ba20-f75fe65c14cd-metrics-client-ca\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392476 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392476 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-root\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392476 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-textfile\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392745 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-sys\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392745 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392499 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvgw8\" (UniqueName: \"kubernetes.io/projected/1210f72a-313a-44d1-ba20-f75fe65c14cd-kube-api-access-qvgw8\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392745 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392745 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-wtmp\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392745 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-tls\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.392994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392806 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-wtmp\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.393111 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1210f72a-313a-44d1-ba20-f75fe65c14cd-root\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.393229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.392845 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-textfile\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.393229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.393017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1210f72a-313a-44d1-ba20-f75fe65c14cd-metrics-client-ca\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.393229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.393017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.395597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.395574 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-tls\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.395728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.395619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1210f72a-313a-44d1-ba20-f75fe65c14cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.401692 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.401667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvgw8\" (UniqueName: \"kubernetes.io/projected/1210f72a-313a-44d1-ba20-f75fe65c14cd-kube-api-access-qvgw8\") pod \"node-exporter-rnbdf\" (UID: \"1210f72a-313a-44d1-ba20-f75fe65c14cd\") " pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.507659 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.507601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.528585 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.528553 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnbdf" Jul 07 02:20:09.567602 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:09.567079 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1210f72a_313a_44d1_ba20_f75fe65c14cd.slice/crio-849cb526a90d42b55a72a0e34497d9f9feab3f43c41b7fbebd49f4121dbf85d2 WatchSource:0}: Error finding container 849cb526a90d42b55a72a0e34497d9f9feab3f43c41b7fbebd49f4121dbf85d2: Status 404 returned error can't find the container with id 849cb526a90d42b55a72a0e34497d9f9feab3f43c41b7fbebd49f4121dbf85d2 Jul 07 02:20:09.573263 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.573231 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:09.987469 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:09.987428 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:10.025931 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:10.025894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnbdf" event={"ID":"1210f72a-313a-44d1-ba20-f75fe65c14cd","Type":"ContainerStarted","Data":"849cb526a90d42b55a72a0e34497d9f9feab3f43c41b7fbebd49f4121dbf85d2"} Jul 07 02:20:10.108656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:10.106989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:10.197095 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:10.196998 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:10.562395 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:10.562286 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:12.038902 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:12.038871 2556 generic.go:356] "Generic (PLEG): container finished" podID="1210f72a-313a-44d1-ba20-f75fe65c14cd" containerID="c9f0c922ddde824565792cb51357c9cee5a3ad1a504051adf3f53eff0e5211d2" exitCode=0 Jul 07 02:20:12.039303 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:12.038960 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnbdf" event={"ID":"1210f72a-313a-44d1-ba20-f75fe65c14cd","Type":"ContainerDied","Data":"c9f0c922ddde824565792cb51357c9cee5a3ad1a504051adf3f53eff0e5211d2"} Jul 07 02:20:12.163457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:12.163424 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:12.262342 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:12.261764 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:12.345458 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:12.345426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:12.593157 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:12.593069 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:13.043564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.043524 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnbdf" event={"ID":"1210f72a-313a-44d1-ba20-f75fe65c14cd","Type":"ContainerStarted","Data":"413e6927c290a46aff3e013b0fe21f11df71229c1332d20c7be85ec8203f50a4"} Jul 07 02:20:13.043958 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.043585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnbdf" event={"ID":"1210f72a-313a-44d1-ba20-f75fe65c14cd","Type":"ContainerStarted","Data":"51731b5f99543be00168904daadb04b76a0aacb3bc9a88c06e1a8215b75eaa86"} Jul 07 02:20:13.061786 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.061744 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rnbdf" podStartSLOduration=2.391985979 podStartE2EDuration="4.061728569s" totalImagesPullingTime="1.561659027s" totalInitContainerRuntime="108.083563ms" isStatefulPod=true podCreationTimestamp="2026-07-07 02:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:13.060972733 +0000 UTC m=+314.555997264" watchObservedRunningTime="2026-07-07 02:20:13.061728569 +0000 UTC m=+314.556753099" Jul 07 02:20:13.435380 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.435277 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b8cdf547f-pcsx6"] Jul 07 02:20:13.460469 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.460432 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b8cdf547f-pcsx6"] Jul 07 02:20:13.460678 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.460566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.462902 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.462881 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-46t1khlepjfaq\"" Jul 07 02:20:13.463044 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.462891 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 02:20:13.463044 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.462891 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 02:20:13.463165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.463049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 02:20:13.463218 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.463171 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zvqlj\"" Jul 07 02:20:13.463313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.463290 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 02:20:13.527415 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527375 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15d79030-8e33-4466-bfe6-5eb7d028b54b-audit-log\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.527622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-client-ca-bundle\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.527622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15d79030-8e33-4466-bfe6-5eb7d028b54b-metrics-server-audit-profiles\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.527622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfbtz\" (UniqueName: \"kubernetes.io/projected/15d79030-8e33-4466-bfe6-5eb7d028b54b-kube-api-access-bfbtz\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.527622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-secret-metrics-server-client-certs\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.527622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15d79030-8e33-4466-bfe6-5eb7d028b54b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.527622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.527604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-secret-metrics-server-tls\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628319 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-secret-metrics-server-tls\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15d79030-8e33-4466-bfe6-5eb7d028b54b-audit-log\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-client-ca-bundle\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15d79030-8e33-4466-bfe6-5eb7d028b54b-metrics-server-audit-profiles\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628606 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfbtz\" (UniqueName: \"kubernetes.io/projected/15d79030-8e33-4466-bfe6-5eb7d028b54b-kube-api-access-bfbtz\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628693 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-secret-metrics-server-client-certs\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628784 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15d79030-8e33-4466-bfe6-5eb7d028b54b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.628898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.628873 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15d79030-8e33-4466-bfe6-5eb7d028b54b-audit-log\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.629389 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.629368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15d79030-8e33-4466-bfe6-5eb7d028b54b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.629478 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.629437 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15d79030-8e33-4466-bfe6-5eb7d028b54b-metrics-server-audit-profiles\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.631201 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.631182 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-secret-metrics-server-client-certs\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.631585 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.631564 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-client-ca-bundle\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.632014 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.631995 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15d79030-8e33-4466-bfe6-5eb7d028b54b-secret-metrics-server-tls\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.636171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.636145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfbtz\" (UniqueName: \"kubernetes.io/projected/15d79030-8e33-4466-bfe6-5eb7d028b54b-kube-api-access-bfbtz\") pod \"metrics-server-5b8cdf547f-pcsx6\" (UID: \"15d79030-8e33-4466-bfe6-5eb7d028b54b\") " pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.769449 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.769410 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:13.911973 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.911932 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:13.920804 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.920685 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4"] Jul 07 02:20:13.951711 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.951679 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4"] Jul 07 02:20:13.951864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.951724 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9646f9b6-56fmv"] Jul 07 02:20:13.951864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.951734 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:13.953740 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.953709 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 02:20:13.953740 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.953721 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rst8d\"" Jul 07 02:20:13.959272 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.959213 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b8cdf547f-pcsx6"] Jul 07 02:20:13.962326 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.962302 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bff855c8d-fjdq5"] Jul 07 02:20:13.963126 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:13.963104 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d79030_8e33_4466_bfe6_5eb7d028b54b.slice/crio-6fc1411072507a0f9016b6d5021b822012c0da34e46521d3a2915f04cd9bc684 WatchSource:0}: Error finding container 6fc1411072507a0f9016b6d5021b822012c0da34e46521d3a2915f04cd9bc684: Status 404 returned error can't find the container with id 6fc1411072507a0f9016b6d5021b822012c0da34e46521d3a2915f04cd9bc684 Jul 07 02:20:13.981391 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.981360 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bff855c8d-fjdq5"] Jul 07 02:20:13.981576 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:13.981485 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.001222 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.001191 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:14.032324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-serving-cert\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.032324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-trusted-ca-bundle\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.032324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l47ph\" (UniqueName: \"kubernetes.io/projected/b65b505f-7921-401e-bfe4-d7bdf7689824-kube-api-access-l47ph\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.032581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-service-ca\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.032581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-console-config\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.032581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-oauth-serving-cert\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.032581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032507 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a72686f3-b327-4e21-9180-8e431803d6e4-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-djqj4\" (UID: \"a72686f3-b327-4e21-9180-8e431803d6e4\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.032581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nkkc\" (UniqueName: \"kubernetes.io/projected/a72686f3-b327-4e21-9180-8e431803d6e4-kube-api-access-9nkkc\") pod \"monitoring-plugin-d5dcff7cf-djqj4\" (UID: \"a72686f3-b327-4e21-9180-8e431803d6e4\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.032581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.032577 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-oauth-config\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.048661 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.048604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" event={"ID":"15d79030-8e33-4466-bfe6-5eb7d028b54b","Type":"ContainerStarted","Data":"6fc1411072507a0f9016b6d5021b822012c0da34e46521d3a2915f04cd9bc684"} Jul 07 02:20:14.112010 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.111981 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:14.133179 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a72686f3-b327-4e21-9180-8e431803d6e4-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-djqj4\" (UID: \"a72686f3-b327-4e21-9180-8e431803d6e4\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.133179 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nkkc\" (UniqueName: \"kubernetes.io/projected/a72686f3-b327-4e21-9180-8e431803d6e4-kube-api-access-9nkkc\") pod \"monitoring-plugin-d5dcff7cf-djqj4\" (UID: \"a72686f3-b327-4e21-9180-8e431803d6e4\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.133416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-oauth-config\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.133416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-serving-cert\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.133416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-trusted-ca-bundle\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.133416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l47ph\" (UniqueName: \"kubernetes.io/projected/b65b505f-7921-401e-bfe4-d7bdf7689824-kube-api-access-l47ph\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.133622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-service-ca\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.133622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-console-config\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.133755 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.133653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-oauth-serving-cert\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.134388 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.134328 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-service-ca\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.134524 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.134475 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-console-config\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.134751 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.134731 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-trusted-ca-bundle\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.135061 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.135027 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-oauth-serving-cert\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.136024 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.136006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a72686f3-b327-4e21-9180-8e431803d6e4-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-djqj4\" (UID: \"a72686f3-b327-4e21-9180-8e431803d6e4\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.136073 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.136057 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-oauth-config\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.136152 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.136134 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-serving-cert\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.141683 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.141661 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nkkc\" (UniqueName: \"kubernetes.io/projected/a72686f3-b327-4e21-9180-8e431803d6e4-kube-api-access-9nkkc\") pod \"monitoring-plugin-d5dcff7cf-djqj4\" (UID: \"a72686f3-b327-4e21-9180-8e431803d6e4\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.142417 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.142399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l47ph\" (UniqueName: \"kubernetes.io/projected/b65b505f-7921-401e-bfe4-d7bdf7689824-kube-api-access-l47ph\") pod \"console-5bff855c8d-fjdq5\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.263770 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.263735 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:14.291813 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.291783 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:14.385191 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.385128 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f8d549d8b-dtblb"] Jul 07 02:20:14.414458 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.414420 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f8d549d8b-dtblb"] Jul 07 02:20:14.414562 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.414546 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.417665 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.417625 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 02:20:14.417787 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.417732 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 02:20:14.417787 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.417746 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 02:20:14.418177 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.417995 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ptcv4\"" Jul 07 02:20:14.418177 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.417996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 02:20:14.418177 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.418074 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 02:20:14.438743 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.438713 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 02:20:14.439188 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.438849 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4"] Jul 07 02:20:14.445459 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:14.445433 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72686f3_b327_4e21_9180_8e431803d6e4.slice/crio-13a72e9506ea6676f75e19e2cbed8ab69b789372c1bd75c005dacc81f7b01079 WatchSource:0}: Error finding container 13a72e9506ea6676f75e19e2cbed8ab69b789372c1bd75c005dacc81f7b01079: Status 404 returned error can't find the container with id 13a72e9506ea6676f75e19e2cbed8ab69b789372c1bd75c005dacc81f7b01079 Jul 07 02:20:14.473336 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.473198 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bff855c8d-fjdq5"] Jul 07 02:20:14.475997 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:14.475970 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65b505f_7921_401e_bfe4_d7bdf7689824.slice/crio-6561a4e3e42174044b2a2788e5c9aec61c2eea3dfa4f726532d14f34e315fb2d WatchSource:0}: Error finding container 6561a4e3e42174044b2a2788e5c9aec61c2eea3dfa4f726532d14f34e315fb2d: Status 404 returned error can't find the container with id 6561a4e3e42174044b2a2788e5c9aec61c2eea3dfa4f726532d14f34e315fb2d Jul 07 02:20:14.537330 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-federate-client-tls\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537438 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-metrics-client-ca\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537438 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4fjv\" (UniqueName: \"kubernetes.io/projected/35e75c1c-4b21-4193-b258-fd352f065e3a-kube-api-access-g4fjv\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537438 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537539 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-serving-certs-ca-bundle\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537539 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537605 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537563 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-secret-telemeter-client\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.537664 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.537609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-telemeter-client-tls\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638408 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638366 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-secret-telemeter-client\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-telemeter-client-tls\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-federate-client-tls\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-metrics-client-ca\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4fjv\" (UniqueName: \"kubernetes.io/projected/35e75c1c-4b21-4193-b258-fd352f065e3a-kube-api-access-g4fjv\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.638690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.639066 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.638712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-serving-certs-ca-bundle\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.639660 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.639418 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.639660 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.639476 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-serving-certs-ca-bundle\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.639837 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.639818 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35e75c1c-4b21-4193-b258-fd352f065e3a-metrics-client-ca\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.642366 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.642324 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-telemeter-client-tls\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.642557 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.642532 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-secret-telemeter-client\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.642896 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.642870 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.643906 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.643881 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35e75c1c-4b21-4193-b258-fd352f065e3a-federate-client-tls\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.649282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.649230 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4fjv\" (UniqueName: \"kubernetes.io/projected/35e75c1c-4b21-4193-b258-fd352f065e3a-kube-api-access-g4fjv\") pod \"telemeter-client-5f8d549d8b-dtblb\" (UID: \"35e75c1c-4b21-4193-b258-fd352f065e3a\") " pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.733267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.733230 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" Jul 07 02:20:14.914885 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:14.914842 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f8d549d8b-dtblb"] Jul 07 02:20:14.919994 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:14.919963 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e75c1c_4b21_4193_b258_fd352f065e3a.slice/crio-675ccce6e56b8d3920062ae70ee8614e8a4d9ee22734f26af13cbbf129622b77 WatchSource:0}: Error finding container 675ccce6e56b8d3920062ae70ee8614e8a4d9ee22734f26af13cbbf129622b77: Status 404 returned error can't find the container with id 675ccce6e56b8d3920062ae70ee8614e8a4d9ee22734f26af13cbbf129622b77 Jul 07 02:20:15.053668 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.053616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" event={"ID":"35e75c1c-4b21-4193-b258-fd352f065e3a","Type":"ContainerStarted","Data":"675ccce6e56b8d3920062ae70ee8614e8a4d9ee22734f26af13cbbf129622b77"} Jul 07 02:20:15.055232 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.055204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bff855c8d-fjdq5" event={"ID":"b65b505f-7921-401e-bfe4-d7bdf7689824","Type":"ContainerStarted","Data":"0f99112cddd9ed469bc9f31be0aad65756a6acae829bdb64dcad796671a03051"} Jul 07 02:20:15.055362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.055263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bff855c8d-fjdq5" event={"ID":"b65b505f-7921-401e-bfe4-d7bdf7689824","Type":"ContainerStarted","Data":"6561a4e3e42174044b2a2788e5c9aec61c2eea3dfa4f726532d14f34e315fb2d"} Jul 07 02:20:15.056219 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.056202 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" event={"ID":"a72686f3-b327-4e21-9180-8e431803d6e4","Type":"ContainerStarted","Data":"13a72e9506ea6676f75e19e2cbed8ab69b789372c1bd75c005dacc81f7b01079"} Jul 07 02:20:15.072578 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.072486 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bff855c8d-fjdq5" podStartSLOduration=2.072471717 podStartE2EDuration="2.072471717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:15.070747027 +0000 UTC m=+316.565771558" watchObservedRunningTime="2026-07-07 02:20:15.072471717 +0000 UTC m=+316.567496247" Jul 07 02:20:15.511832 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.511796 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:15.823069 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:15.822982 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:20:17.066878 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:17.066843 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" event={"ID":"15d79030-8e33-4466-bfe6-5eb7d028b54b","Type":"ContainerStarted","Data":"400ed910bbfbc040089344f66dcc4e07f08a878933e8e5156a7886a81ed5807c"} Jul 07 02:20:17.069124 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:17.069101 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" event={"ID":"a72686f3-b327-4e21-9180-8e431803d6e4","Type":"ContainerStarted","Data":"ef748e9509189b3c4d112c596f5e1f281837df8b1d0f9d1a17b2e5e2c1a05b26"} Jul 07 02:20:17.069287 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:17.069250 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:17.075021 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:17.074998 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" Jul 07 02:20:17.086338 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:17.086286 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" podStartSLOduration=1.475085306 podStartE2EDuration="4.08626522s" totalImagesPullingTime="2.611179914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:17.085015248 +0000 UTC m=+318.580039779" watchObservedRunningTime="2026-07-07 02:20:17.08626522 +0000 UTC m=+318.581289752" Jul 07 02:20:17.102078 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:17.102022 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-djqj4" podStartSLOduration=1.618173932 podStartE2EDuration="4.102001532s" totalImagesPullingTime="2.4838276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:17.100823672 +0000 UTC m=+318.595848207" watchObservedRunningTime="2026-07-07 02:20:17.102001532 +0000 UTC m=+318.597026065" Jul 07 02:20:18.074783 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:18.074749 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" event={"ID":"35e75c1c-4b21-4193-b258-fd352f065e3a","Type":"ContainerStarted","Data":"a4222a8d08267fd7c8158d46a7b7043b39179be8eb801fd48e77cbcc9f1cf5a1"} Jul 07 02:20:19.434324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:19.434293 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:19.493164 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:19.493138 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:20.084828 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:20.084794 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" event={"ID":"35e75c1c-4b21-4193-b258-fd352f065e3a","Type":"ContainerStarted","Data":"bfe67807e26b622cbf4b8456f5586c4805859078ed25b3225a2dbf2f63edff03"} Jul 07 02:20:20.085014 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:20.084855 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" event={"ID":"35e75c1c-4b21-4193-b258-fd352f065e3a","Type":"ContainerStarted","Data":"350b78fa3e432306206067360c75038a7b5f4f052fdb096b668e6b662c0d24c3"} Jul 07 02:20:20.108653 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:20.108558 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f8d549d8b-dtblb" podStartSLOduration=1.66906495 podStartE2EDuration="6.108537572s" totalImagesPullingTime="4.439472622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:20.107558571 +0000 UTC m=+321.602583101" watchObservedRunningTime="2026-07-07 02:20:20.108537572 +0000 UTC m=+321.603562104" Jul 07 02:20:21.006311 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.006268 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bff855c8d-fjdq5"] Jul 07 02:20:21.063064 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.063025 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-754647cd7d-269wh"] Jul 07 02:20:21.081662 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.081603 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.088327 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.088295 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754647cd7d-269wh"] Jul 07 02:20:21.199069 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-trusted-ca-bundle\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.199267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-oauth-serving-cert\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.199267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-oauth-config\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.199267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-service-ca\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.199423 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-serving-cert\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.199474 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfvr4\" (UniqueName: \"kubernetes.io/projected/07e9f099-c29f-4684-a238-b05579ea5325-kube-api-access-rfvr4\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.199527 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.199477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-console-config\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.300849 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.300763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-trusted-ca-bundle\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.300849 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.300816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-oauth-serving-cert\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301067 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.300854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-oauth-config\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301067 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.300870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-service-ca\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301067 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.300896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-serving-cert\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301067 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.301050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfvr4\" (UniqueName: \"kubernetes.io/projected/07e9f099-c29f-4684-a238-b05579ea5325-kube-api-access-rfvr4\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301223 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.301097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-console-config\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301653 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.301616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-trusted-ca-bundle\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301941 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.301780 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-service-ca\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301941 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.301780 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-oauth-serving-cert\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.301941 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.301883 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-console-config\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.303679 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.303655 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-oauth-config\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.303782 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.303766 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-serving-cert\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.309736 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.309709 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfvr4\" (UniqueName: \"kubernetes.io/projected/07e9f099-c29f-4684-a238-b05579ea5325-kube-api-access-rfvr4\") pod \"console-754647cd7d-269wh\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.392585 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.392546 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:21.591677 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:21.591585 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754647cd7d-269wh"] Jul 07 02:20:21.594505 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:20:21.594479 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e9f099_c29f_4684_a238_b05579ea5325.slice/crio-b690555ba65bf896d51477272e9aa6d1b48e278c2af339f9c0e2d1ff22f2a921 WatchSource:0}: Error finding container b690555ba65bf896d51477272e9aa6d1b48e278c2af339f9c0e2d1ff22f2a921: Status 404 returned error can't find the container with id b690555ba65bf896d51477272e9aa6d1b48e278c2af339f9c0e2d1ff22f2a921 Jul 07 02:20:22.094597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:22.094563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754647cd7d-269wh" event={"ID":"07e9f099-c29f-4684-a238-b05579ea5325","Type":"ContainerStarted","Data":"951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb"} Jul 07 02:20:22.095019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:22.094612 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754647cd7d-269wh" event={"ID":"07e9f099-c29f-4684-a238-b05579ea5325","Type":"ContainerStarted","Data":"b690555ba65bf896d51477272e9aa6d1b48e278c2af339f9c0e2d1ff22f2a921"} Jul 07 02:20:22.111728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:22.111675 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-754647cd7d-269wh" podStartSLOduration=1.111626991 podStartE2EDuration="1.111626991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:22.111495991 +0000 UTC m=+323.606520522" watchObservedRunningTime="2026-07-07 02:20:22.111626991 +0000 UTC m=+323.606651522" Jul 07 02:20:24.292545 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:24.292506 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:31.393234 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:31.393192 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:31.393670 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:31.393258 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:31.398259 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:31.398230 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:32.136541 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:32.136504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:20:32.312392 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:32.312347 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:32.410425 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:32.410345 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:32.512429 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:32.512403 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:33.770248 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:33.770210 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:33.770704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:33.770270 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:34.447780 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:34.447742 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:34.546900 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:34.546866 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:38.979168 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:38.979103 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f9646f9b6-56fmv" podUID="92d07d10-ba3d-424f-b6d4-6b915c4b88b5" containerName="console" containerID="cri-o://368709f4c7604bab8e349e8640c85357bc14c521d32fb3a3b3048ffe1c13a5e9" gracePeriod=15 Jul 07 02:20:39.161097 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.161067 2556 generic.go:356] "Generic (PLEG): container finished" podID="92d07d10-ba3d-424f-b6d4-6b915c4b88b5" containerID="368709f4c7604bab8e349e8640c85357bc14c521d32fb3a3b3048ffe1c13a5e9" exitCode=0 Jul 07 02:20:39.161245 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.161151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9646f9b6-56fmv" event={"ID":"92d07d10-ba3d-424f-b6d4-6b915c4b88b5","Type":"ContainerDied","Data":"368709f4c7604bab8e349e8640c85357bc14c521d32fb3a3b3048ffe1c13a5e9"} Jul 07 02:20:39.265174 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.265148 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:20:39.366580 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366545 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-service-ca\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.366789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366598 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-oauth-serving-cert\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.366789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366654 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-config\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.366789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366672 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-serving-cert\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.366789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366718 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4twwj\" (UniqueName: \"kubernetes.io/projected/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-kube-api-access-4twwj\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.366789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366755 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-trusted-ca-bundle\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.366789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366779 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-oauth-config\") pod \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\" (UID: \"92d07d10-ba3d-424f-b6d4-6b915c4b88b5\") " Jul 07 02:20:39.367097 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.366939 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:39.367097 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.367059 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-service-ca\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:39.367201 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.367107 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-config" (OuterVolumeSpecName: "console-config") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:39.367201 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.367129 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:39.367267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.367201 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:39.369037 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.369015 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:39.369127 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.369114 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-kube-api-access-4twwj" (OuterVolumeSpecName: "kube-api-access-4twwj") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "kube-api-access-4twwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:39.369179 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.369137 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92d07d10-ba3d-424f-b6d4-6b915c4b88b5" (UID: "92d07d10-ba3d-424f-b6d4-6b915c4b88b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:39.468013 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.467977 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-oauth-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:39.468013 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.468009 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:39.468013 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.468023 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:39.468267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.468035 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4twwj\" (UniqueName: \"kubernetes.io/projected/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-kube-api-access-4twwj\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:39.468267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.468046 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-trusted-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:39.468267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:39.468057 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d07d10-ba3d-424f-b6d4-6b915c4b88b5-console-oauth-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:40.166488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:40.166447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9646f9b6-56fmv" event={"ID":"92d07d10-ba3d-424f-b6d4-6b915c4b88b5","Type":"ContainerDied","Data":"61e7c4515ee5f5a9576eecd5f2870c4da950c7eb5f9038e314d71de9e1ee762d"} Jul 07 02:20:40.166488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:40.166471 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9646f9b6-56fmv" Jul 07 02:20:40.166991 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:40.166519 2556 scope.go:117] "RemoveContainer" containerID="368709f4c7604bab8e349e8640c85357bc14c521d32fb3a3b3048ffe1c13a5e9" Jul 07 02:20:40.185143 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:40.185120 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9646f9b6-56fmv"] Jul 07 02:20:40.188769 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:40.188746 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f9646f9b6-56fmv"] Jul 07 02:20:41.044485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:41.044451 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92d07d10-ba3d-424f-b6d4-6b915c4b88b5" path="/var/lib/kubelet/pods/92d07d10-ba3d-424f-b6d4-6b915c4b88b5/volumes" Jul 07 02:20:41.439288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:41.439212 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:41.540594 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:41.540560 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:41.593619 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:41.593592 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:46.027366 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.027302 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bff855c8d-fjdq5" podUID="b65b505f-7921-401e-bfe4-d7bdf7689824" containerName="console" containerID="cri-o://0f99112cddd9ed469bc9f31be0aad65756a6acae829bdb64dcad796671a03051" gracePeriod=15 Jul 07 02:20:46.190744 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.190709 2556 generic.go:356] "Generic (PLEG): container finished" podID="b65b505f-7921-401e-bfe4-d7bdf7689824" containerID="0f99112cddd9ed469bc9f31be0aad65756a6acae829bdb64dcad796671a03051" exitCode=0 Jul 07 02:20:46.190905 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.190777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bff855c8d-fjdq5" event={"ID":"b65b505f-7921-401e-bfe4-d7bdf7689824","Type":"ContainerDied","Data":"0f99112cddd9ed469bc9f31be0aad65756a6acae829bdb64dcad796671a03051"} Jul 07 02:20:46.317921 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.317891 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:46.429678 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429620 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-serving-cert\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.429890 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429724 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l47ph\" (UniqueName: \"kubernetes.io/projected/b65b505f-7921-401e-bfe4-d7bdf7689824-kube-api-access-l47ph\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.429890 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429754 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-console-config\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.429890 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429784 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-oauth-config\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.429890 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429808 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-trusted-ca-bundle\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.429890 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429832 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-service-ca\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.430145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.429908 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-oauth-serving-cert\") pod \"b65b505f-7921-401e-bfe4-d7bdf7689824\" (UID: \"b65b505f-7921-401e-bfe4-d7bdf7689824\") " Jul 07 02:20:46.430712 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.430682 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-console-config" (OuterVolumeSpecName: "console-config") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:46.430850 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.430710 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-service-ca" (OuterVolumeSpecName: "service-ca") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:46.430850 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.430783 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:46.430962 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.430932 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:46.432315 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.432287 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65b505f-7921-401e-bfe4-d7bdf7689824-kube-api-access-l47ph" (OuterVolumeSpecName: "kube-api-access-l47ph") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "kube-api-access-l47ph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:46.432463 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.432443 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:46.432553 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.432536 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b65b505f-7921-401e-bfe4-d7bdf7689824" (UID: "b65b505f-7921-401e-bfe4-d7bdf7689824"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531103 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-oauth-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531127 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531136 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l47ph\" (UniqueName: \"kubernetes.io/projected/b65b505f-7921-401e-bfe4-d7bdf7689824-kube-api-access-l47ph\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531145 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-console-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531153 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b65b505f-7921-401e-bfe4-d7bdf7689824-console-oauth-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531161 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-trusted-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:46.531189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:46.531169 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b65b505f-7921-401e-bfe4-d7bdf7689824-service-ca\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.196386 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:47.196354 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bff855c8d-fjdq5" Jul 07 02:20:47.196386 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:47.196364 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bff855c8d-fjdq5" event={"ID":"b65b505f-7921-401e-bfe4-d7bdf7689824","Type":"ContainerDied","Data":"6561a4e3e42174044b2a2788e5c9aec61c2eea3dfa4f726532d14f34e315fb2d"} Jul 07 02:20:47.196920 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:47.196418 2556 scope.go:117] "RemoveContainer" containerID="0f99112cddd9ed469bc9f31be0aad65756a6acae829bdb64dcad796671a03051" Jul 07 02:20:47.210799 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:47.210770 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bff855c8d-fjdq5"] Jul 07 02:20:47.216067 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:47.216036 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bff855c8d-fjdq5"] Jul 07 02:20:49.041191 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:49.041116 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65b505f-7921-401e-bfe4-d7bdf7689824" path="/var/lib/kubelet/pods/b65b505f-7921-401e-bfe4-d7bdf7689824/volumes" Jul 07 02:20:53.775306 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:53.775277 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:20:53.779040 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:20:53.779015 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b8cdf547f-pcsx6" Jul 07 02:21:02.573853 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:02.573818 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:02.678421 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:02.678385 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:02.775092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:02.775061 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:02.944235 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:02.944126 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:03.002625 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:03.002591 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:10.253133 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:10.253101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:10.306149 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:10.306108 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:12.758600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:12.758564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:21:12.761032 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:12.761014 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ba5b83-9449-46d8-b751-d001dc7bd041-metrics-certs\") pod \"network-metrics-daemon-w2kkp\" (UID: \"e6ba5b83-9449-46d8-b751-d001dc7bd041\") " pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:21:13.038737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:13.038631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92x5k\"" Jul 07 02:21:13.046468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:13.046446 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w2kkp" Jul 07 02:21:13.180923 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:13.180875 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w2kkp"] Jul 07 02:21:13.299315 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:13.299231 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w2kkp" event={"ID":"e6ba5b83-9449-46d8-b751-d001dc7bd041","Type":"ContainerStarted","Data":"e562db8bc7ea3fd19650cf87b8499f8035adf3cae5222c40d2f67af7263bd0b7"} Jul 07 02:21:14.304977 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:14.304886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w2kkp" event={"ID":"e6ba5b83-9449-46d8-b751-d001dc7bd041","Type":"ContainerStarted","Data":"60b6ab00f5691f96c1a4dd4a1a8b4b662f73e9f878001839dcefb69207e2545a"} Jul 07 02:21:14.304977 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:14.304951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w2kkp" event={"ID":"e6ba5b83-9449-46d8-b751-d001dc7bd041","Type":"ContainerStarted","Data":"c9057b4b1e9364b5b71e450521b734bcd67657210c7e173b93db58ed5c85cee8"} Jul 07 02:21:14.321376 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:14.321331 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w2kkp" podStartSLOduration=374.465533162 podStartE2EDuration="6m15.321315488s" totalImagesPullingTime="855.782326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:14.320224345 +0000 UTC m=+375.815248877" watchObservedRunningTime="2026-07-07 02:21:14.321315488 +0000 UTC m=+375.816340018" Jul 07 02:21:14.422069 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:14.422038 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:14.523595 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:14.523565 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:25.336806 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.336773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:25.396336 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.396304 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:25.612583 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612512 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7856d7d968-8pjx6"] Jul 07 02:21:25.612824 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612812 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d07d10-ba3d-424f-b6d4-6b915c4b88b5" containerName="console" Jul 07 02:21:25.612866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612826 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d07d10-ba3d-424f-b6d4-6b915c4b88b5" containerName="console" Jul 07 02:21:25.612866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612847 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65b505f-7921-401e-bfe4-d7bdf7689824" containerName="console" Jul 07 02:21:25.612866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612852 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65b505f-7921-401e-bfe4-d7bdf7689824" containerName="console" Jul 07 02:21:25.612955 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612907 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65b505f-7921-401e-bfe4-d7bdf7689824" containerName="console" Jul 07 02:21:25.612955 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.612916 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d07d10-ba3d-424f-b6d4-6b915c4b88b5" containerName="console" Jul 07 02:21:25.614858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.614835 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.631156 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.631129 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7856d7d968-8pjx6"] Jul 07 02:21:25.676767 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.676735 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:25.745823 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.745793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:25.769945 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.769909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2wst\" (UniqueName: \"kubernetes.io/projected/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-kube-api-access-v2wst\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.770058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.769973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-trusted-ca-bundle\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.770058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.770047 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-oauth-config\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.770125 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.770070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-oauth-serving-cert\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.770125 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.770089 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-serving-cert\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.770125 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.770116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-service-ca\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.770224 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.770167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-config\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871397 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-config\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871397 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2wst\" (UniqueName: \"kubernetes.io/projected/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-kube-api-access-v2wst\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871626 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871417 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-trusted-ca-bundle\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871626 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-oauth-config\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871626 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-oauth-serving-cert\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871626 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-serving-cert\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.871626 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.871530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-service-ca\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.872257 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.872226 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-config\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.872358 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.872233 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-oauth-serving-cert\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.872477 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.872459 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-trusted-ca-bundle\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.872513 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.872493 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-service-ca\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.874104 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.874088 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-oauth-config\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.874203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.874185 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-serving-cert\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.880023 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.879998 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2wst\" (UniqueName: \"kubernetes.io/projected/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-kube-api-access-v2wst\") pod \"console-7856d7d968-8pjx6\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:25.924536 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:25.924497 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:26.070203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:26.070171 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7856d7d968-8pjx6"] Jul 07 02:21:26.073071 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:21:26.073046 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1d06e8_f6b0_4cf3_9b23_1728345097e7.slice/crio-d8c86030b0daf76d2f45537c57cb5947401faa0b34009242cae6251c0c27e0ee WatchSource:0}: Error finding container d8c86030b0daf76d2f45537c57cb5947401faa0b34009242cae6251c0c27e0ee: Status 404 returned error can't find the container with id d8c86030b0daf76d2f45537c57cb5947401faa0b34009242cae6251c0c27e0ee Jul 07 02:21:26.351117 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:26.351081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7856d7d968-8pjx6" event={"ID":"3d1d06e8-f6b0-4cf3-9b23-1728345097e7","Type":"ContainerStarted","Data":"b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5"} Jul 07 02:21:26.351546 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:26.351130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7856d7d968-8pjx6" event={"ID":"3d1d06e8-f6b0-4cf3-9b23-1728345097e7","Type":"ContainerStarted","Data":"d8c86030b0daf76d2f45537c57cb5947401faa0b34009242cae6251c0c27e0ee"} Jul 07 02:21:26.370457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:26.370389 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7856d7d968-8pjx6" podStartSLOduration=1.3703656419999999 podStartE2EDuration="1.370365642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:26.369075181 +0000 UTC m=+387.864099713" watchObservedRunningTime="2026-07-07 02:21:26.370365642 +0000 UTC m=+387.865390174" Jul 07 02:21:35.681103 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:35.681062 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:35.741009 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:35.740978 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:35.925601 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:35.925558 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:35.925823 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:35.925676 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:35.930529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:35.930497 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:36.394866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:36.394838 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:21:36.437867 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:36.437835 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754647cd7d-269wh"] Jul 07 02:21:36.539997 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:36.539951 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:37.320926 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:37.320899 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:37.421609 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:37.421582 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:49.445352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:49.445313 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:49.546462 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:49.546426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:52.509693 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:21:52.509656 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:01.465531 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.465471 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-754647cd7d-269wh" podUID="07e9f099-c29f-4684-a238-b05579ea5325" containerName="console" containerID="cri-o://951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb" gracePeriod=15 Jul 07 02:22:01.710113 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.710087 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:22:01.757971 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.757878 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-service-ca\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.757971 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.757933 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfvr4\" (UniqueName: \"kubernetes.io/projected/07e9f099-c29f-4684-a238-b05579ea5325-kube-api-access-rfvr4\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.758194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.757978 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-serving-cert\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.758194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758006 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-console-config\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.758194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758041 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-trusted-ca-bundle\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.758194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758075 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-oauth-serving-cert\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.758194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758110 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-oauth-config\") pod \"07e9f099-c29f-4684-a238-b05579ea5325\" (UID: \"07e9f099-c29f-4684-a238-b05579ea5325\") " Jul 07 02:22:01.758478 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758439 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-service-ca" (OuterVolumeSpecName: "service-ca") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:22:01.758546 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758489 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:22:01.758595 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758533 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-console-config" (OuterVolumeSpecName: "console-config") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:22:01.758595 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.758544 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:22:01.760355 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.760325 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:22:01.760355 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.760329 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e9f099-c29f-4684-a238-b05579ea5325-kube-api-access-rfvr4" (OuterVolumeSpecName: "kube-api-access-rfvr4") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "kube-api-access-rfvr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:22:01.760498 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.760385 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07e9f099-c29f-4684-a238-b05579ea5325" (UID: "07e9f099-c29f-4684-a238-b05579ea5325"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:22:01.859549 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859506 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:01.859549 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859541 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-console-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:01.859549 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859555 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-trusted-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:01.859833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859566 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-oauth-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:01.859833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859578 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e9f099-c29f-4684-a238-b05579ea5325-console-oauth-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:01.859833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859589 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9f099-c29f-4684-a238-b05579ea5325-service-ca\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:01.859833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:01.859602 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfvr4\" (UniqueName: \"kubernetes.io/projected/07e9f099-c29f-4684-a238-b05579ea5325-kube-api-access-rfvr4\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:02.493949 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.493916 2556 generic.go:356] "Generic (PLEG): container finished" podID="07e9f099-c29f-4684-a238-b05579ea5325" containerID="951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb" exitCode=0 Jul 07 02:22:02.494413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.493965 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754647cd7d-269wh" Jul 07 02:22:02.494413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.494013 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754647cd7d-269wh" event={"ID":"07e9f099-c29f-4684-a238-b05579ea5325","Type":"ContainerDied","Data":"951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb"} Jul 07 02:22:02.494413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.494077 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754647cd7d-269wh" event={"ID":"07e9f099-c29f-4684-a238-b05579ea5325","Type":"ContainerDied","Data":"b690555ba65bf896d51477272e9aa6d1b48e278c2af339f9c0e2d1ff22f2a921"} Jul 07 02:22:02.494413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.494110 2556 scope.go:117] "RemoveContainer" containerID="951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb" Jul 07 02:22:02.503460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.503442 2556 scope.go:117] "RemoveContainer" containerID="951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb" Jul 07 02:22:02.503822 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:22:02.503797 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb\": container with ID starting with 951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb not found: ID does not exist" containerID="951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb" Jul 07 02:22:02.503906 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.503836 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb"} err="failed to get container status \"951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb\": rpc error: code = NotFound desc = could not find container \"951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb\": container with ID starting with 951a561a46fbf965fffd6bb87f460b46148faf7bce9e0c2c38fb829f28a9acbb not found: ID does not exist" Jul 07 02:22:02.516470 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.516438 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754647cd7d-269wh"] Jul 07 02:22:02.523763 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:02.523726 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-754647cd7d-269wh"] Jul 07 02:22:03.041000 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:03.040969 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e9f099-c29f-4684-a238-b05579ea5325" path="/var/lib/kubelet/pods/07e9f099-c29f-4684-a238-b05579ea5325/volumes" Jul 07 02:22:26.564018 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:26.563972 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:26.658886 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:26.658852 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:27.212319 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.212282 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb"] Jul 07 02:22:27.212578 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.212567 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e9f099-c29f-4684-a238-b05579ea5325" containerName="console" Jul 07 02:22:27.212620 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.212580 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e9f099-c29f-4684-a238-b05579ea5325" containerName="console" Jul 07 02:22:27.212680 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.212658 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e9f099-c29f-4684-a238-b05579ea5325" containerName="console" Jul 07 02:22:27.214910 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.214890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.217153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.217130 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qltb6\"" Jul 07 02:22:27.217274 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.217175 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 02:22:27.217600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.217582 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 02:22:27.228714 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.228685 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb"] Jul 07 02:22:27.368223 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.368187 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.368406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.368251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4q5s\" (UniqueName: \"kubernetes.io/projected/9b8ce53a-b28b-4df4-8599-358a2b19d177-kube-api-access-t4q5s\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.368406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.368316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.469337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.469232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4q5s\" (UniqueName: \"kubernetes.io/projected/9b8ce53a-b28b-4df4-8599-358a2b19d177-kube-api-access-t4q5s\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.469337 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.469294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.469519 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.469363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.469743 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.469712 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.469867 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.469763 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.478425 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.478395 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4q5s\" (UniqueName: \"kubernetes.io/projected/9b8ce53a-b28b-4df4-8599-358a2b19d177-kube-api-access-t4q5s\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.525030 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.524974 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:27.665115 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:27.664931 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb"] Jul 07 02:22:27.667827 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:22:27.667796 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8ce53a_b28b_4df4_8599_358a2b19d177.slice/crio-d256ff46f8d7145c67350e6d310bc74047cec58cddbb412d796cc039dcc34f1a WatchSource:0}: Error finding container d256ff46f8d7145c67350e6d310bc74047cec58cddbb412d796cc039dcc34f1a: Status 404 returned error can't find the container with id d256ff46f8d7145c67350e6d310bc74047cec58cddbb412d796cc039dcc34f1a Jul 07 02:22:28.599975 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:28.599934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" event={"ID":"9b8ce53a-b28b-4df4-8599-358a2b19d177","Type":"ContainerStarted","Data":"d256ff46f8d7145c67350e6d310bc74047cec58cddbb412d796cc039dcc34f1a"} Jul 07 02:22:34.627043 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:34.627005 2556 generic.go:356] "Generic (PLEG): container finished" podID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerID="01e1384ba783f740ad7957f4ffb7ccdc169d5fe7ef636124dc9ccfd8f4e3afc5" exitCode=0 Jul 07 02:22:34.627459 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:34.627064 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" event={"ID":"9b8ce53a-b28b-4df4-8599-358a2b19d177","Type":"ContainerDied","Data":"01e1384ba783f740ad7957f4ffb7ccdc169d5fe7ef636124dc9ccfd8f4e3afc5"} Jul 07 02:22:37.642257 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:37.642221 2556 generic.go:356] "Generic (PLEG): container finished" podID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerID="5eb66ce15af80d798b2f6dd68bae3115386d430f9cf3f4f6f76585b01c070165" exitCode=0 Jul 07 02:22:37.642662 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:37.642287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" event={"ID":"9b8ce53a-b28b-4df4-8599-358a2b19d177","Type":"ContainerDied","Data":"5eb66ce15af80d798b2f6dd68bae3115386d430f9cf3f4f6f76585b01c070165"} Jul 07 02:22:44.676131 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:44.676051 2556 generic.go:356] "Generic (PLEG): container finished" podID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerID="bba06dcc7b4ff34a228f34a339efceff75cc7019cbc8bf07d0a5cc5e20fbc130" exitCode=0 Jul 07 02:22:44.676131 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:44.676089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" event={"ID":"9b8ce53a-b28b-4df4-8599-358a2b19d177","Type":"ContainerDied","Data":"bba06dcc7b4ff34a228f34a339efceff75cc7019cbc8bf07d0a5cc5e20fbc130"} Jul 07 02:22:45.802984 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.802957 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:45.825056 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.825029 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-util\") pod \"9b8ce53a-b28b-4df4-8599-358a2b19d177\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " Jul 07 02:22:45.825222 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.825081 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4q5s\" (UniqueName: \"kubernetes.io/projected/9b8ce53a-b28b-4df4-8599-358a2b19d177-kube-api-access-t4q5s\") pod \"9b8ce53a-b28b-4df4-8599-358a2b19d177\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " Jul 07 02:22:45.825222 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.825203 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-bundle\") pod \"9b8ce53a-b28b-4df4-8599-358a2b19d177\" (UID: \"9b8ce53a-b28b-4df4-8599-358a2b19d177\") " Jul 07 02:22:45.825809 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.825780 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-bundle" (OuterVolumeSpecName: "bundle") pod "9b8ce53a-b28b-4df4-8599-358a2b19d177" (UID: "9b8ce53a-b28b-4df4-8599-358a2b19d177"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:22:45.827438 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.827401 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8ce53a-b28b-4df4-8599-358a2b19d177-kube-api-access-t4q5s" (OuterVolumeSpecName: "kube-api-access-t4q5s") pod "9b8ce53a-b28b-4df4-8599-358a2b19d177" (UID: "9b8ce53a-b28b-4df4-8599-358a2b19d177"). InnerVolumeSpecName "kube-api-access-t4q5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:22:45.829529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.829501 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-util" (OuterVolumeSpecName: "util") pod "9b8ce53a-b28b-4df4-8599-358a2b19d177" (UID: "9b8ce53a-b28b-4df4-8599-358a2b19d177"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:22:45.925874 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.925842 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:45.925874 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.925874 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b8ce53a-b28b-4df4-8599-358a2b19d177-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:45.926055 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:45.925888 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4q5s\" (UniqueName: \"kubernetes.io/projected/9b8ce53a-b28b-4df4-8599-358a2b19d177-kube-api-access-t4q5s\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:22:46.685972 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:46.685932 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" Jul 07 02:22:46.686172 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:46.685934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rljqb" event={"ID":"9b8ce53a-b28b-4df4-8599-358a2b19d177","Type":"ContainerDied","Data":"d256ff46f8d7145c67350e6d310bc74047cec58cddbb412d796cc039dcc34f1a"} Jul 07 02:22:46.686172 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:46.686062 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d256ff46f8d7145c67350e6d310bc74047cec58cddbb412d796cc039dcc34f1a" Jul 07 02:22:48.247466 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:48.247428 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:49.092225 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:49.092192 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:50.253851 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.253812 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq"] Jul 07 02:22:50.254352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254238 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="pull" Jul 07 02:22:50.254352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254255 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="pull" Jul 07 02:22:50.254352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254268 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="util" Jul 07 02:22:50.254352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254277 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="util" Jul 07 02:22:50.254352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254300 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="extract" Jul 07 02:22:50.254352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254307 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="extract" Jul 07 02:22:50.254686 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.254383 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8ce53a-b28b-4df4-8599-358a2b19d177" containerName="extract" Jul 07 02:22:50.269949 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.269925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.270819 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.270793 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq"] Jul 07 02:22:50.271967 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.271943 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:22:50.272599 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.272578 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 02:22:50.272793 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.272701 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bstkn\"" Jul 07 02:22:50.362147 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.362104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnccb\" (UniqueName: \"kubernetes.io/projected/3f0dcc31-2340-479e-8c5b-da9ad5338947-kube-api-access-wnccb\") pod \"cert-manager-operator-controller-manager-55c444bf86-7qnlq\" (UID: \"3f0dcc31-2340-479e-8c5b-da9ad5338947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.362147 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.362144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f0dcc31-2340-479e-8c5b-da9ad5338947-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7qnlq\" (UID: \"3f0dcc31-2340-479e-8c5b-da9ad5338947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.463105 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.463069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnccb\" (UniqueName: \"kubernetes.io/projected/3f0dcc31-2340-479e-8c5b-da9ad5338947-kube-api-access-wnccb\") pod \"cert-manager-operator-controller-manager-55c444bf86-7qnlq\" (UID: \"3f0dcc31-2340-479e-8c5b-da9ad5338947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.463105 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.463109 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f0dcc31-2340-479e-8c5b-da9ad5338947-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7qnlq\" (UID: \"3f0dcc31-2340-479e-8c5b-da9ad5338947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.463477 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.463459 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f0dcc31-2340-479e-8c5b-da9ad5338947-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7qnlq\" (UID: \"3f0dcc31-2340-479e-8c5b-da9ad5338947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.481287 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.481260 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnccb\" (UniqueName: \"kubernetes.io/projected/3f0dcc31-2340-479e-8c5b-da9ad5338947-kube-api-access-wnccb\") pod \"cert-manager-operator-controller-manager-55c444bf86-7qnlq\" (UID: \"3f0dcc31-2340-479e-8c5b-da9ad5338947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.585212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.585127 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" Jul 07 02:22:50.745694 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:50.745626 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq"] Jul 07 02:22:50.748777 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:22:50.748750 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0dcc31_2340_479e_8c5b_da9ad5338947.slice/crio-f5875e493d1966f63872ac0821717766dc8d18553eb902d4dcdedc1090a6c46b WatchSource:0}: Error finding container f5875e493d1966f63872ac0821717766dc8d18553eb902d4dcdedc1090a6c46b: Status 404 returned error can't find the container with id f5875e493d1966f63872ac0821717766dc8d18553eb902d4dcdedc1090a6c46b Jul 07 02:22:51.708686 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:51.708628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" event={"ID":"3f0dcc31-2340-479e-8c5b-da9ad5338947","Type":"ContainerStarted","Data":"f5875e493d1966f63872ac0821717766dc8d18553eb902d4dcdedc1090a6c46b"} Jul 07 02:22:51.859406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:51.859368 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:51.962236 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:51.962185 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:53.545814 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.545779 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:53.646548 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.646513 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:53.717977 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.717939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" event={"ID":"3f0dcc31-2340-479e-8c5b-da9ad5338947","Type":"ContainerStarted","Data":"c72a423476f382940fc8c4d4f2c2c504cb7187e2c50ae9a483c4ba2c7f35c012"} Jul 07 02:22:53.727451 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.727421 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xtjpg"] Jul 07 02:22:53.742757 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.742730 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xtjpg"] Jul 07 02:22:53.742903 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.742821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:53.745229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.745204 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 02:22:53.745392 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.745376 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-d97km\"" Jul 07 02:22:53.745651 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.745552 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 02:22:53.746132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.746081 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7qnlq" podStartSLOduration=1.761645066 podStartE2EDuration="3.746064329s" totalImagesPullingTime="1.984419263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:22:53.745118961 +0000 UTC m=+475.240143493" watchObservedRunningTime="2026-07-07 02:22:53.746064329 +0000 UTC m=+475.241088861" Jul 07 02:22:53.791707 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.791679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc3c09c3-6a9e-4a04-91da-638607d50e48-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xtjpg\" (UID: \"fc3c09c3-6a9e-4a04-91da-638607d50e48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:53.791870 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.791719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpngh\" (UniqueName: \"kubernetes.io/projected/fc3c09c3-6a9e-4a04-91da-638607d50e48-kube-api-access-bpngh\") pod \"cert-manager-webhook-6486ffd997-xtjpg\" (UID: \"fc3c09c3-6a9e-4a04-91da-638607d50e48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:53.893093 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.893006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc3c09c3-6a9e-4a04-91da-638607d50e48-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xtjpg\" (UID: \"fc3c09c3-6a9e-4a04-91da-638607d50e48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:53.893093 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.893048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpngh\" (UniqueName: \"kubernetes.io/projected/fc3c09c3-6a9e-4a04-91da-638607d50e48-kube-api-access-bpngh\") pod \"cert-manager-webhook-6486ffd997-xtjpg\" (UID: \"fc3c09c3-6a9e-4a04-91da-638607d50e48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:53.905205 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.905174 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc3c09c3-6a9e-4a04-91da-638607d50e48-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xtjpg\" (UID: \"fc3c09c3-6a9e-4a04-91da-638607d50e48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:53.905317 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:53.905287 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpngh\" (UniqueName: \"kubernetes.io/projected/fc3c09c3-6a9e-4a04-91da-638607d50e48-kube-api-access-bpngh\") pod \"cert-manager-webhook-6486ffd997-xtjpg\" (UID: \"fc3c09c3-6a9e-4a04-91da-638607d50e48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:54.063029 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.062996 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:54.188669 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.188625 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:54.212756 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.212724 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xtjpg"] Jul 07 02:22:54.215658 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:22:54.215614 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc3c09c3_6a9e_4a04_91da_638607d50e48.slice/crio-72aaade5b25b549eb629b539f8cfe7549594f68ee70d0f559601c32370d5d718 WatchSource:0}: Error finding container 72aaade5b25b549eb629b539f8cfe7549594f68ee70d0f559601c32370d5d718: Status 404 returned error can't find the container with id 72aaade5b25b549eb629b539f8cfe7549594f68ee70d0f559601c32370d5d718 Jul 07 02:22:54.299748 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.299713 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:54.712611 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.712576 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz"] Jul 07 02:22:54.715352 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.715334 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.717617 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.717597 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 02:22:54.717759 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.717663 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 02:22:54.717838 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.717775 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qltb6\"" Jul 07 02:22:54.729307 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.729275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" event={"ID":"fc3c09c3-6a9e-4a04-91da-638607d50e48","Type":"ContainerStarted","Data":"72aaade5b25b549eb629b539f8cfe7549594f68ee70d0f559601c32370d5d718"} Jul 07 02:22:54.732902 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.732876 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz"] Jul 07 02:22:54.800553 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.800514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzqb\" (UniqueName: \"kubernetes.io/projected/f8aad782-02e7-4b53-b4a6-2d3259979771-kube-api-access-sqzqb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.800735 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.800572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.800735 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.800682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.901922 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.901889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzqb\" (UniqueName: \"kubernetes.io/projected/f8aad782-02e7-4b53-b4a6-2d3259979771-kube-api-access-sqzqb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.902113 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.901933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.902113 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.901976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.902402 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.902368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.902402 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.902386 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:54.914502 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:54.914477 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzqb\" (UniqueName: \"kubernetes.io/projected/f8aad782-02e7-4b53-b4a6-2d3259979771-kube-api-access-sqzqb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:55.028246 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.028149 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:22:55.188173 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.188139 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz"] Jul 07 02:22:55.191651 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:22:55.191606 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aad782_02e7_4b53_b4a6_2d3259979771.slice/crio-b9fb773dffe7f8ef401f7480dde87f08e8b1e902b16149f469388e9bed545a1d WatchSource:0}: Error finding container b9fb773dffe7f8ef401f7480dde87f08e8b1e902b16149f469388e9bed545a1d: Status 404 returned error can't find the container with id b9fb773dffe7f8ef401f7480dde87f08e8b1e902b16149f469388e9bed545a1d Jul 07 02:22:55.581916 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.581824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:55.735774 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.735744 2556 generic.go:356] "Generic (PLEG): container finished" podID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerID="752376c647eaf564c837e30e52d264574cfb6eabc90e59b5730ca323f8921b34" exitCode=0 Jul 07 02:22:55.736251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.735816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" event={"ID":"f8aad782-02e7-4b53-b4a6-2d3259979771","Type":"ContainerDied","Data":"752376c647eaf564c837e30e52d264574cfb6eabc90e59b5730ca323f8921b34"} Jul 07 02:22:55.736251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.735874 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" event={"ID":"f8aad782-02e7-4b53-b4a6-2d3259979771","Type":"ContainerStarted","Data":"b9fb773dffe7f8ef401f7480dde87f08e8b1e902b16149f469388e9bed545a1d"} Jul 07 02:22:55.943565 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:55.943524 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:56.182822 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.182742 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn"] Jul 07 02:22:56.185434 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.185412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.187574 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.187546 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nnpnz\"" Jul 07 02:22:56.195605 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.195581 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn"] Jul 07 02:22:56.214335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.214305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ca4fe49-a44b-4330-854e-87cbfbbfb055-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqvqn\" (UID: \"4ca4fe49-a44b-4330-854e-87cbfbbfb055\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.214516 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.214343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxpn\" (UniqueName: \"kubernetes.io/projected/4ca4fe49-a44b-4330-854e-87cbfbbfb055-kube-api-access-fsxpn\") pod \"cert-manager-cainjector-559cdd8c87-hqvqn\" (UID: \"4ca4fe49-a44b-4330-854e-87cbfbbfb055\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.315653 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.315596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxpn\" (UniqueName: \"kubernetes.io/projected/4ca4fe49-a44b-4330-854e-87cbfbbfb055-kube-api-access-fsxpn\") pod \"cert-manager-cainjector-559cdd8c87-hqvqn\" (UID: \"4ca4fe49-a44b-4330-854e-87cbfbbfb055\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.315826 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.315738 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ca4fe49-a44b-4330-854e-87cbfbbfb055-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqvqn\" (UID: \"4ca4fe49-a44b-4330-854e-87cbfbbfb055\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.324297 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.324269 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ca4fe49-a44b-4330-854e-87cbfbbfb055-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqvqn\" (UID: \"4ca4fe49-a44b-4330-854e-87cbfbbfb055\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.324454 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.324420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxpn\" (UniqueName: \"kubernetes.io/projected/4ca4fe49-a44b-4330-854e-87cbfbbfb055-kube-api-access-fsxpn\") pod \"cert-manager-cainjector-559cdd8c87-hqvqn\" (UID: \"4ca4fe49-a44b-4330-854e-87cbfbbfb055\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:56.496331 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:56.496288 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" Jul 07 02:22:57.014468 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:57.014439 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn"] Jul 07 02:22:57.749165 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:57.749131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" event={"ID":"fc3c09c3-6a9e-4a04-91da-638607d50e48","Type":"ContainerStarted","Data":"682f1699e2ca7c966b7bed499adbc409c9889ef7c9bb12139d3ac847a3b28f8a"} Jul 07 02:22:57.749376 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:57.749187 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:22:57.750998 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:57.750969 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" event={"ID":"4ca4fe49-a44b-4330-854e-87cbfbbfb055","Type":"ContainerStarted","Data":"147508c45b178a052d369cdcaefca10131bb35a499bf84e698c8b6b0e4ba8153"} Jul 07 02:22:57.751108 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:57.751008 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" event={"ID":"4ca4fe49-a44b-4330-854e-87cbfbbfb055","Type":"ContainerStarted","Data":"b1553f329f5c405f0029711a7c19dbf285797f7c9105add4a6f769aed9ebb85a"} Jul 07 02:22:57.765534 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:57.765468 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" podStartSLOduration=2.06731534 podStartE2EDuration="4.765445852s" totalImagesPullingTime="2.698130512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:22:57.763591191 +0000 UTC m=+479.258615734" watchObservedRunningTime="2026-07-07 02:22:57.765445852 +0000 UTC m=+479.260470384" Jul 07 02:22:58.757141 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:58.757109 2556 generic.go:356] "Generic (PLEG): container finished" podID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerID="1077b3addebbfefc70abb51e7204e66cc0bac1a83b97dd0589cc4ae7bdcc7a41" exitCode=0 Jul 07 02:22:58.757575 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:58.757204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" event={"ID":"f8aad782-02e7-4b53-b4a6-2d3259979771","Type":"ContainerDied","Data":"1077b3addebbfefc70abb51e7204e66cc0bac1a83b97dd0589cc4ae7bdcc7a41"} Jul 07 02:22:58.774331 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:58.774272 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqvqn" podStartSLOduration=2.774247464 podStartE2EDuration="2.774247464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:22:57.77919834 +0000 UTC m=+479.274222874" watchObservedRunningTime="2026-07-07 02:22:58.774247464 +0000 UTC m=+480.269271998" Jul 07 02:22:58.844406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:58.844378 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:58.944737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:58.944703 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:59.764719 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:59.764684 2556 generic.go:356] "Generic (PLEG): container finished" podID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerID="e69942db1ee410031f6c6ce183f50b9a814a6554557b0d106fbdf148115d6dcc" exitCode=0 Jul 07 02:22:59.765106 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:22:59.764779 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" event={"ID":"f8aad782-02e7-4b53-b4a6-2d3259979771","Type":"ContainerDied","Data":"e69942db1ee410031f6c6ce183f50b9a814a6554557b0d106fbdf148115d6dcc"} Jul 07 02:23:00.904730 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.904703 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:23:00.953838 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.953803 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqzqb\" (UniqueName: \"kubernetes.io/projected/f8aad782-02e7-4b53-b4a6-2d3259979771-kube-api-access-sqzqb\") pod \"f8aad782-02e7-4b53-b4a6-2d3259979771\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " Jul 07 02:23:00.953838 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.953843 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-util\") pod \"f8aad782-02e7-4b53-b4a6-2d3259979771\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " Jul 07 02:23:00.954050 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.953926 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-bundle\") pod \"f8aad782-02e7-4b53-b4a6-2d3259979771\" (UID: \"f8aad782-02e7-4b53-b4a6-2d3259979771\") " Jul 07 02:23:00.954303 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.954267 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-bundle" (OuterVolumeSpecName: "bundle") pod "f8aad782-02e7-4b53-b4a6-2d3259979771" (UID: "f8aad782-02e7-4b53-b4a6-2d3259979771"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:23:00.956083 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.956060 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8aad782-02e7-4b53-b4a6-2d3259979771-kube-api-access-sqzqb" (OuterVolumeSpecName: "kube-api-access-sqzqb") pod "f8aad782-02e7-4b53-b4a6-2d3259979771" (UID: "f8aad782-02e7-4b53-b4a6-2d3259979771"). InnerVolumeSpecName "kube-api-access-sqzqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:23:00.959362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:00.959338 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-util" (OuterVolumeSpecName: "util") pod "f8aad782-02e7-4b53-b4a6-2d3259979771" (UID: "f8aad782-02e7-4b53-b4a6-2d3259979771"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:23:01.054485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:01.054461 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:23:01.054485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:01.054484 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqzqb\" (UniqueName: \"kubernetes.io/projected/f8aad782-02e7-4b53-b4a6-2d3259979771-kube-api-access-sqzqb\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:23:01.054689 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:01.054494 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8aad782-02e7-4b53-b4a6-2d3259979771-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:23:01.784298 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:01.784261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" event={"ID":"f8aad782-02e7-4b53-b4a6-2d3259979771","Type":"ContainerDied","Data":"b9fb773dffe7f8ef401f7480dde87f08e8b1e902b16149f469388e9bed545a1d"} Jul 07 02:23:01.784469 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:01.784345 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9fb773dffe7f8ef401f7480dde87f08e8b1e902b16149f469388e9bed545a1d" Jul 07 02:23:01.784469 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:01.784253 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbr2lz" Jul 07 02:23:03.760488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:03.760451 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xtjpg" Jul 07 02:23:04.358236 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:04.358207 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:05.246553 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:05.246522 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:05.346576 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:05.346544 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:12.645981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:12.645945 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:12.745456 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:12.745422 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:14.337490 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337446 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9"] Jul 07 02:23:14.337898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337810 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="util" Jul 07 02:23:14.337898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337822 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="util" Jul 07 02:23:14.337898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337840 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="extract" Jul 07 02:23:14.337898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337846 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="extract" Jul 07 02:23:14.337898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337857 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="pull" Jul 07 02:23:14.337898 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337864 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="pull" Jul 07 02:23:14.338095 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.337924 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8aad782-02e7-4b53-b4a6-2d3259979771" containerName="extract" Jul 07 02:23:14.341244 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.341227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.343735 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.343702 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qltb6\"" Jul 07 02:23:14.343735 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.343720 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 02:23:14.344007 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.343992 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 02:23:14.350693 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.350667 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9"] Jul 07 02:23:14.472656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.472600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq4kp\" (UniqueName: \"kubernetes.io/projected/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-kube-api-access-zq4kp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.472852 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.472720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.472852 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.472782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.573615 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.573574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq4kp\" (UniqueName: \"kubernetes.io/projected/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-kube-api-access-zq4kp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.573840 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.573670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.573840 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.573707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.574136 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.574115 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.574136 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.574123 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.581996 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.581969 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq4kp\" (UniqueName: \"kubernetes.io/projected/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-kube-api-access-zq4kp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.650658 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.650545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:14.785852 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.785821 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9"] Jul 07 02:23:14.789473 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:23:14.789445 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7e0fd8_aaac_4c7d_8e42_e158254a496e.slice/crio-36cad4e8454a1c239bcfea77e6f700a398c79ebfebab42ef84058a193809960e WatchSource:0}: Error finding container 36cad4e8454a1c239bcfea77e6f700a398c79ebfebab42ef84058a193809960e: Status 404 returned error can't find the container with id 36cad4e8454a1c239bcfea77e6f700a398c79ebfebab42ef84058a193809960e Jul 07 02:23:14.842552 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.842520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" event={"ID":"6b7e0fd8-aaac-4c7d-8e42-e158254a496e","Type":"ContainerStarted","Data":"36cad4e8454a1c239bcfea77e6f700a398c79ebfebab42ef84058a193809960e"} Jul 07 02:23:14.907153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:14.907063 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:15.848394 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:15.848293 2556 generic.go:356] "Generic (PLEG): container finished" podID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerID="bec5f0da244e82a3f40d7812df1dcdce5118c672156641daaba06ab63124b932" exitCode=0 Jul 07 02:23:15.848394 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:15.848356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" event={"ID":"6b7e0fd8-aaac-4c7d-8e42-e158254a496e","Type":"ContainerDied","Data":"bec5f0da244e82a3f40d7812df1dcdce5118c672156641daaba06ab63124b932"} Jul 07 02:23:16.855095 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:16.855061 2556 generic.go:356] "Generic (PLEG): container finished" podID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerID="b3fdea3484e0e557f0971291f2240fbf6dded6b561cdbe69bb23a978ca03d381" exitCode=0 Jul 07 02:23:16.855513 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:16.855145 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" event={"ID":"6b7e0fd8-aaac-4c7d-8e42-e158254a496e","Type":"ContainerDied","Data":"b3fdea3484e0e557f0971291f2240fbf6dded6b561cdbe69bb23a978ca03d381"} Jul 07 02:23:16.959021 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:16.958987 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:17.064926 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:17.064893 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:17.865478 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:17.865441 2556 generic.go:356] "Generic (PLEG): container finished" podID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerID="e4df4f0ec1fcc50051ed2e1c47d4a5c3185160cde5f94191dcc2d28ef0dba257" exitCode=0 Jul 07 02:23:17.865874 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:17.865504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" event={"ID":"6b7e0fd8-aaac-4c7d-8e42-e158254a496e","Type":"ContainerDied","Data":"e4df4f0ec1fcc50051ed2e1c47d4a5c3185160cde5f94191dcc2d28ef0dba257"} Jul 07 02:23:18.998932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:18.998906 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:19.119015 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.118973 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq4kp\" (UniqueName: \"kubernetes.io/projected/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-kube-api-access-zq4kp\") pod \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " Jul 07 02:23:19.119187 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.119033 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-bundle\") pod \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " Jul 07 02:23:19.119187 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.119071 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-util\") pod \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\" (UID: \"6b7e0fd8-aaac-4c7d-8e42-e158254a496e\") " Jul 07 02:23:19.119820 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.119790 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-bundle" (OuterVolumeSpecName: "bundle") pod "6b7e0fd8-aaac-4c7d-8e42-e158254a496e" (UID: "6b7e0fd8-aaac-4c7d-8e42-e158254a496e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:23:19.121330 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.121266 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-kube-api-access-zq4kp" (OuterVolumeSpecName: "kube-api-access-zq4kp") pod "6b7e0fd8-aaac-4c7d-8e42-e158254a496e" (UID: "6b7e0fd8-aaac-4c7d-8e42-e158254a496e"). InnerVolumeSpecName "kube-api-access-zq4kp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:23:19.124439 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.124398 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-util" (OuterVolumeSpecName: "util") pod "6b7e0fd8-aaac-4c7d-8e42-e158254a496e" (UID: "6b7e0fd8-aaac-4c7d-8e42-e158254a496e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:23:19.220071 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.220028 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq4kp\" (UniqueName: \"kubernetes.io/projected/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-kube-api-access-zq4kp\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:23:19.220071 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.220063 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:23:19.220071 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.220072 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0fd8-aaac-4c7d-8e42-e158254a496e-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:23:19.877509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.877472 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" Jul 07 02:23:19.877509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.877492 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7gtn9" event={"ID":"6b7e0fd8-aaac-4c7d-8e42-e158254a496e","Type":"ContainerDied","Data":"36cad4e8454a1c239bcfea77e6f700a398c79ebfebab42ef84058a193809960e"} Jul 07 02:23:19.877801 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:19.877539 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36cad4e8454a1c239bcfea77e6f700a398c79ebfebab42ef84058a193809960e" Jul 07 02:23:30.254302 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:30.254266 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:30.359209 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:30.359176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:30.866887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:30.866858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.113781 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.113745 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.229910 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.229879 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.271830 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.271793 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn"] Jul 07 02:23:31.272203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272120 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="extract" Jul 07 02:23:31.272203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272131 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="extract" Jul 07 02:23:31.272203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272146 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="pull" Jul 07 02:23:31.272203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272152 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="pull" Jul 07 02:23:31.272203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272162 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="util" Jul 07 02:23:31.272203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272167 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="util" Jul 07 02:23:31.272384 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.272238 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7e0fd8-aaac-4c7d-8e42-e158254a496e" containerName="extract" Jul 07 02:23:31.279472 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.279437 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.282204 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.282179 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 02:23:31.282384 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.282283 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sj57n\"" Jul 07 02:23:31.282384 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.282286 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 02:23:31.282384 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.282300 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 02:23:31.282546 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.282389 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 02:23:31.290701 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.290676 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn"] Jul 07 02:23:31.412779 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.412746 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.425921 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.425892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/115e3778-6036-4ae1-b670-fcc9bc195805-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.426009 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.425931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/115e3778-6036-4ae1-b670-fcc9bc195805-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.426009 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.425951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfj22\" (UniqueName: \"kubernetes.io/projected/115e3778-6036-4ae1-b670-fcc9bc195805-kube-api-access-mfj22\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.426009 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.426002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/115e3778-6036-4ae1-b670-fcc9bc195805-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.426132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.426111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115e3778-6036-4ae1-b670-fcc9bc195805-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.511282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.511199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.527428 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.527385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/115e3778-6036-4ae1-b670-fcc9bc195805-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.527581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.527433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj22\" (UniqueName: \"kubernetes.io/projected/115e3778-6036-4ae1-b670-fcc9bc195805-kube-api-access-mfj22\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.527581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.527462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/115e3778-6036-4ae1-b670-fcc9bc195805-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.527581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.527524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115e3778-6036-4ae1-b670-fcc9bc195805-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.527774 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.527593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/115e3778-6036-4ae1-b670-fcc9bc195805-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.528023 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.528002 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/115e3778-6036-4ae1-b670-fcc9bc195805-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.530025 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.530004 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/115e3778-6036-4ae1-b670-fcc9bc195805-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.530155 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.530138 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/115e3778-6036-4ae1-b670-fcc9bc195805-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.530311 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.530291 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/115e3778-6036-4ae1-b670-fcc9bc195805-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.535967 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.535930 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfj22\" (UniqueName: \"kubernetes.io/projected/115e3778-6036-4ae1-b670-fcc9bc195805-kube-api-access-mfj22\") pod \"opendatahub-operator-controller-manager-778f769c96-r47kn\" (UID: \"115e3778-6036-4ae1-b670-fcc9bc195805\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.591615 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.591575 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:31.611313 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.611283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.720430 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.720399 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.750234 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.750155 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn"] Jul 07 02:23:31.752741 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:23:31.752709 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115e3778_6036_4ae1_b670_fcc9bc195805.slice/crio-55af871cb110bd98e8f84b0f27e84355a912d5264f9c9a04921e55acf7b73990 WatchSource:0}: Error finding container 55af871cb110bd98e8f84b0f27e84355a912d5264f9c9a04921e55acf7b73990: Status 404 returned error can't find the container with id 55af871cb110bd98e8f84b0f27e84355a912d5264f9c9a04921e55acf7b73990 Jul 07 02:23:31.812255 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.812164 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:31.931460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:31.931424 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" event={"ID":"115e3778-6036-4ae1-b670-fcc9bc195805","Type":"ContainerStarted","Data":"55af871cb110bd98e8f84b0f27e84355a912d5264f9c9a04921e55acf7b73990"} Jul 07 02:23:34.950703 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:34.950588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" event={"ID":"115e3778-6036-4ae1-b670-fcc9bc195805","Type":"ContainerStarted","Data":"3e9d31b79eb668ac0d44c74a73008aed6009d686cd77c465c1017cd83a2b01dc"} Jul 07 02:23:35.956422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:35.956333 2556 generic.go:356] "Generic (PLEG): container finished" podID="115e3778-6036-4ae1-b670-fcc9bc195805" containerID="3e9d31b79eb668ac0d44c74a73008aed6009d686cd77c465c1017cd83a2b01dc" exitCode=0 Jul 07 02:23:35.956422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:35.956385 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" event={"ID":"115e3778-6036-4ae1-b670-fcc9bc195805","Type":"ContainerDied","Data":"3e9d31b79eb668ac0d44c74a73008aed6009d686cd77c465c1017cd83a2b01dc"} Jul 07 02:23:36.963415 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:36.963365 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" event={"ID":"115e3778-6036-4ae1-b670-fcc9bc195805","Type":"ContainerStarted","Data":"40d5e16393f6d465b874254e38acbd95a90d7a2e44a54e90991dffa130363110"} Jul 07 02:23:36.963889 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:36.963462 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:36.984451 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:36.984391 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" podStartSLOduration=1.781226691 podStartE2EDuration="5.984376717s" totalImagesPullingTime="3.198228288s" totalInitContainerRuntime="1.004921738s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:36.983345954 +0000 UTC m=+518.478370490" watchObservedRunningTime="2026-07-07 02:23:36.984376717 +0000 UTC m=+518.479401247" Jul 07 02:23:39.128209 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:39.128170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:39.250847 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:39.250816 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:47.970320 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:47.970288 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r47kn" Jul 07 02:23:49.934152 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:49.934066 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:50.183671 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.183616 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:50.773933 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.773897 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fmfm6"] Jul 07 02:23:50.777257 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.777232 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:50.780181 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.780153 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 02:23:50.780296 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.780161 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4zmjl\"" Jul 07 02:23:50.821473 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.821425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fmfm6"] Jul 07 02:23:50.834151 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.834117 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:50.880736 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.880700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe03661b-9f5f-4b82-ae91-f91895259b43-cert\") pod \"odh-model-controller-7998c67dc4-fmfm6\" (UID: \"fe03661b-9f5f-4b82-ae91-f91895259b43\") " pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:50.880915 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.880810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgrvq\" (UniqueName: \"kubernetes.io/projected/fe03661b-9f5f-4b82-ae91-f91895259b43-kube-api-access-wgrvq\") pod \"odh-model-controller-7998c67dc4-fmfm6\" (UID: \"fe03661b-9f5f-4b82-ae91-f91895259b43\") " pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:50.955955 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.955923 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:50.981382 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.981350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe03661b-9f5f-4b82-ae91-f91895259b43-cert\") pod \"odh-model-controller-7998c67dc4-fmfm6\" (UID: \"fe03661b-9f5f-4b82-ae91-f91895259b43\") " pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:50.981535 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.981400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgrvq\" (UniqueName: \"kubernetes.io/projected/fe03661b-9f5f-4b82-ae91-f91895259b43-kube-api-access-wgrvq\") pod \"odh-model-controller-7998c67dc4-fmfm6\" (UID: \"fe03661b-9f5f-4b82-ae91-f91895259b43\") " pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:50.984232 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.984206 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe03661b-9f5f-4b82-ae91-f91895259b43-cert\") pod \"odh-model-controller-7998c67dc4-fmfm6\" (UID: \"fe03661b-9f5f-4b82-ae91-f91895259b43\") " pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:50.992104 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:50.992079 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgrvq\" (UniqueName: \"kubernetes.io/projected/fe03661b-9f5f-4b82-ae91-f91895259b43-kube-api-access-wgrvq\") pod \"odh-model-controller-7998c67dc4-fmfm6\" (UID: \"fe03661b-9f5f-4b82-ae91-f91895259b43\") " pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:51.052205 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.052116 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:51.087914 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.087876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:51.155625 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.155577 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:51.241329 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.241303 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fmfm6"] Jul 07 02:23:51.244008 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:23:51.243977 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe03661b_9f5f_4b82_ae91_f91895259b43.slice/crio-03c291aed2a808d76b4384cd11798712ce044854c0b8e6b5042718991f523a42 WatchSource:0}: Error finding container 03c291aed2a808d76b4384cd11798712ce044854c0b8e6b5042718991f523a42: Status 404 returned error can't find the container with id 03c291aed2a808d76b4384cd11798712ce044854c0b8e6b5042718991f523a42 Jul 07 02:23:51.629260 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.629222 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:51.633997 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.633971 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvgjj"] Jul 07 02:23:51.638218 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.638202 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:51.640705 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.640682 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-d6m6q\"" Jul 07 02:23:51.640818 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.640773 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 02:23:51.646705 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.646682 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvgjj"] Jul 07 02:23:51.686835 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.686800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c36ac8b2-b206-4be3-b8af-09e1017b7e25-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:51.686989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.686861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qgl\" (UniqueName: \"kubernetes.io/projected/c36ac8b2-b206-4be3-b8af-09e1017b7e25-kube-api-access-q5qgl\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:51.787995 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.787955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qgl\" (UniqueName: \"kubernetes.io/projected/c36ac8b2-b206-4be3-b8af-09e1017b7e25-kube-api-access-q5qgl\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:51.788171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.788023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c36ac8b2-b206-4be3-b8af-09e1017b7e25-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:51.788171 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:23:51.788125 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 07 02:23:51.788253 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:23:51.788187 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36ac8b2-b206-4be3-b8af-09e1017b7e25-tls-certs podName:c36ac8b2-b206-4be3-b8af-09e1017b7e25 nodeName:}" failed. No retries permitted until 2026-07-07 02:23:52.288170704 +0000 UTC m=+533.783195212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c36ac8b2-b206-4be3-b8af-09e1017b7e25-tls-certs") pod "model-serving-api-54d89bd5fc-kvgjj" (UID: "c36ac8b2-b206-4be3-b8af-09e1017b7e25") : secret "model-serving-api-tls" not found Jul 07 02:23:51.796675 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.796616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qgl\" (UniqueName: \"kubernetes.io/projected/c36ac8b2-b206-4be3-b8af-09e1017b7e25-kube-api-access-q5qgl\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:51.874881 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:51.874846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:52.040405 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:52.040368 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" event={"ID":"fe03661b-9f5f-4b82-ae91-f91895259b43","Type":"ContainerStarted","Data":"03c291aed2a808d76b4384cd11798712ce044854c0b8e6b5042718991f523a42"} Jul 07 02:23:52.292951 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:52.292859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c36ac8b2-b206-4be3-b8af-09e1017b7e25-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:52.301425 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:52.301364 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c36ac8b2-b206-4be3-b8af-09e1017b7e25-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvgjj\" (UID: \"c36ac8b2-b206-4be3-b8af-09e1017b7e25\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:52.551763 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:52.551659 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:52.755275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:52.755242 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvgjj"] Jul 07 02:23:52.759923 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:23:52.759859 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36ac8b2_b206_4be3_b8af_09e1017b7e25.slice/crio-9d3b26b0b2ac965783c35cbc53ca555221b230aa05d69fadb0c86963ee69c22a WatchSource:0}: Error finding container 9d3b26b0b2ac965783c35cbc53ca555221b230aa05d69fadb0c86963ee69c22a: Status 404 returned error can't find the container with id 9d3b26b0b2ac965783c35cbc53ca555221b230aa05d69fadb0c86963ee69c22a Jul 07 02:23:53.048563 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:53.048518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" event={"ID":"c36ac8b2-b206-4be3-b8af-09e1017b7e25","Type":"ContainerStarted","Data":"9d3b26b0b2ac965783c35cbc53ca555221b230aa05d69fadb0c86963ee69c22a"} Jul 07 02:23:55.061345 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.061306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" event={"ID":"fe03661b-9f5f-4b82-ae91-f91895259b43","Type":"ContainerStarted","Data":"b727e542edec7d90b42cdf818007409c4e3b24aa52a954393e4982c3cc13bcba"} Jul 07 02:23:55.061756 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.061445 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:23:55.081565 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.081505 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" podStartSLOduration=2.196256318 podStartE2EDuration="5.081489091s" totalImagesPullingTime="2.885232773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:55.079399446 +0000 UTC m=+536.574423977" watchObservedRunningTime="2026-07-07 02:23:55.081489091 +0000 UTC m=+536.576513664" Jul 07 02:23:55.913516 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.913433 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk"] Jul 07 02:23:55.916934 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.916913 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:55.918130 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.918090 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:55.918957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.918940 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 02:23:55.919265 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.919248 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 02:23:55.919447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.919429 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 02:23:55.919523 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.919469 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 02:23:55.941799 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:55.941772 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk"] Jul 07 02:23:56.030717 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.030683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0284b30-881e-45e1-82ba-6425509ab352-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.030873 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.030725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0284b30-881e-45e1-82ba-6425509ab352-tmp\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.030947 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.030924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvp8z\" (UniqueName: \"kubernetes.io/projected/d0284b30-881e-45e1-82ba-6425509ab352-kube-api-access-rvp8z\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.067841 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.067808 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" event={"ID":"c36ac8b2-b206-4be3-b8af-09e1017b7e25","Type":"ContainerStarted","Data":"c0a9eea69b4d96328fb2aebc361e64ccf5f929fbf76208f4506a64403c93e05c"} Jul 07 02:23:56.068254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.068073 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:23:56.083879 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.083829 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" podStartSLOduration=2.282765632 podStartE2EDuration="5.083812152s" totalImagesPullingTime="2.80104652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:56.082897293 +0000 UTC m=+537.577921826" watchObservedRunningTime="2026-07-07 02:23:56.083812152 +0000 UTC m=+537.578836683" Jul 07 02:23:56.132406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.132368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0284b30-881e-45e1-82ba-6425509ab352-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.132406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.132401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0284b30-881e-45e1-82ba-6425509ab352-tmp\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.132761 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:23:56.132506 2556 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 02:23:56.132761 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:23:56.132591 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0284b30-881e-45e1-82ba-6425509ab352-tls-certs podName:d0284b30-881e-45e1-82ba-6425509ab352 nodeName:}" failed. No retries permitted until 2026-07-07 02:23:56.632558635 +0000 UTC m=+538.127583158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d0284b30-881e-45e1-82ba-6425509ab352-tls-certs") pod "kube-auth-proxy-654bb68cf4-8kvmk" (UID: "d0284b30-881e-45e1-82ba-6425509ab352") : secret "kube-auth-proxy-tls" not found Jul 07 02:23:56.132761 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.132739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvp8z\" (UniqueName: \"kubernetes.io/projected/d0284b30-881e-45e1-82ba-6425509ab352-kube-api-access-rvp8z\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.134951 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.134929 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0284b30-881e-45e1-82ba-6425509ab352-tmp\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.141132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.141111 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvp8z\" (UniqueName: \"kubernetes.io/projected/d0284b30-881e-45e1-82ba-6425509ab352-kube-api-access-rvp8z\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.241204 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.241174 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:56.637948 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.637849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0284b30-881e-45e1-82ba-6425509ab352-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.640738 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.640711 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0284b30-881e-45e1-82ba-6425509ab352-tls-certs\") pod \"kube-auth-proxy-654bb68cf4-8kvmk\" (UID: \"d0284b30-881e-45e1-82ba-6425509ab352\") " pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.827974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.827934 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" Jul 07 02:23:56.976033 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:56.976008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk"] Jul 07 02:23:56.978804 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:23:56.978751 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0284b30_881e_45e1_82ba_6425509ab352.slice/crio-7b015d5b7b4c0919761f5244c24a77f27a02d49487ac285b47d8cc1e3266ccd9 WatchSource:0}: Error finding container 7b015d5b7b4c0919761f5244c24a77f27a02d49487ac285b47d8cc1e3266ccd9: Status 404 returned error can't find the container with id 7b015d5b7b4c0919761f5244c24a77f27a02d49487ac285b47d8cc1e3266ccd9 Jul 07 02:23:57.075351 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.075304 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" event={"ID":"d0284b30-881e-45e1-82ba-6425509ab352","Type":"ContainerStarted","Data":"7b015d5b7b4c0919761f5244c24a77f27a02d49487ac285b47d8cc1e3266ccd9"} Jul 07 02:23:57.124793 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.124761 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:57.225305 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.225267 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:57.321562 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.321516 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:57.908240 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.908205 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7"] Jul 07 02:23:57.911679 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.911621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:57.916132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.916110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n7fnj\"" Jul 07 02:23:57.916132 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.916121 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:23:57.916305 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.916157 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 02:23:57.916305 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.916238 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 02:23:57.916406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.916388 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 02:23:57.916450 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.916433 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 02:23:57.924329 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.924309 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7"] Jul 07 02:23:57.951013 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.950977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a544554a-6329-4264-9afd-7f44250c4bf1-manager-config\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:57.951170 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.951066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a544554a-6329-4264-9afd-7f44250c4bf1-cert\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:57.951249 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.951178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a544554a-6329-4264-9afd-7f44250c4bf1-metrics-cert\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:57.951304 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:57.951271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcww\" (UniqueName: \"kubernetes.io/projected/a544554a-6329-4264-9afd-7f44250c4bf1-kube-api-access-plcww\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.052239 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.052200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a544554a-6329-4264-9afd-7f44250c4bf1-metrics-cert\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.052435 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.052266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcww\" (UniqueName: \"kubernetes.io/projected/a544554a-6329-4264-9afd-7f44250c4bf1-kube-api-access-plcww\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.052435 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.052306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a544554a-6329-4264-9afd-7f44250c4bf1-manager-config\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.052435 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.052333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a544554a-6329-4264-9afd-7f44250c4bf1-cert\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.053377 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.053344 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a544554a-6329-4264-9afd-7f44250c4bf1-manager-config\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.055253 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.055225 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a544554a-6329-4264-9afd-7f44250c4bf1-cert\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.055366 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.055319 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a544554a-6329-4264-9afd-7f44250c4bf1-metrics-cert\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.062178 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.062151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcww\" (UniqueName: \"kubernetes.io/projected/a544554a-6329-4264-9afd-7f44250c4bf1-kube-api-access-plcww\") pod \"lws-controller-manager-7fb48ccbfc-j52m7\" (UID: \"a544554a-6329-4264-9afd-7f44250c4bf1\") " pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.222300 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.222260 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:23:58.410975 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.410938 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7"] Jul 07 02:23:58.412943 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:23:58.412911 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda544554a_6329_4264_9afd_7f44250c4bf1.slice/crio-adf883f9a2764e2b7e9c4763dab718baec34727d6abbe52ed884133a3bd7db56 WatchSource:0}: Error finding container adf883f9a2764e2b7e9c4763dab718baec34727d6abbe52ed884133a3bd7db56: Status 404 returned error can't find the container with id adf883f9a2764e2b7e9c4763dab718baec34727d6abbe52ed884133a3bd7db56 Jul 07 02:23:58.551516 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:58.551423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:59.086385 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:23:59.086339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" event={"ID":"a544554a-6329-4264-9afd-7f44250c4bf1","Type":"ContainerStarted","Data":"adf883f9a2764e2b7e9c4763dab718baec34727d6abbe52ed884133a3bd7db56"} Jul 07 02:24:00.531180 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:00.531156 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 02:24:01.098984 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:01.098946 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" event={"ID":"d0284b30-881e-45e1-82ba-6425509ab352","Type":"ContainerStarted","Data":"a2d66a2b343b90af3c6cbe89bbf292db51c869bd20d309e416408f5617185914"} Jul 07 02:24:01.100354 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:01.100326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" event={"ID":"a544554a-6329-4264-9afd-7f44250c4bf1","Type":"ContainerStarted","Data":"847d5ee925c526efcf30ef0627d85c19fb821679d5577e1ebf588aea88bb98bf"} Jul 07 02:24:01.100471 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:01.100457 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:24:01.117086 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:01.117033 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-654bb68cf4-8kvmk" podStartSLOduration=2.569002737 podStartE2EDuration="6.117015886s" totalImagesPullingTime="3.548013149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:01.115547154 +0000 UTC m=+542.610571685" watchObservedRunningTime="2026-07-07 02:24:01.117015886 +0000 UTC m=+542.612040417" Jul 07 02:24:01.139622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:01.139562 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" podStartSLOduration=2.025797946 podStartE2EDuration="4.139542166s" totalImagesPullingTime="2.11374422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:01.139307757 +0000 UTC m=+542.634332289" watchObservedRunningTime="2026-07-07 02:24:01.139542166 +0000 UTC m=+542.634566698" Jul 07 02:24:01.957084 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:01.957048 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:02.106581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:02.106550 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:02.716355 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:02.716328 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:02.838253 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:02.838221 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:02.949266 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:02.949222 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:03.059245 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:03.059141 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:03.238859 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:03.238829 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:03.649840 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:03.649803 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:03.941432 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:03.941343 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:04.100662 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:04.100596 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:04.587753 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:04.587716 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:04.700253 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:04.700216 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:04.797653 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:04.797595 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:06.070958 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:06.070923 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fmfm6" Jul 07 02:24:07.080057 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:07.080028 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvgjj" Jul 07 02:24:10.493697 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:10.493660 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:10.557076 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:10.557045 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:12.108189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:12.108160 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb48ccbfc-j52m7" Jul 07 02:24:17.747928 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:17.747892 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:20.822650 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:20.822609 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:22.197775 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:22.197744 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:51.419324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:51.419275 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:52.770390 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:24:52.770356 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:01.790657 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:01.790505 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:25:01.794324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:01.790675 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:25:01.794324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:01.793539 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:25:01.794324 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:01.793610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:25:07.334422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.331340 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v"] Jul 07 02:25:07.336403 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.336375 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.341153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.341091 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7mtwz\"" Jul 07 02:25:07.341281 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.341163 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 02:25:07.341410 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.341381 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 02:25:07.344854 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.344829 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v"] Jul 07 02:25:07.460506 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.460474 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.460704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.460574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.460704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.460649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7x2\" (UniqueName: \"kubernetes.io/projected/b79ee471-c4fb-48ad-a09b-91760a1f51b8-kube-api-access-vm7x2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.561960 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.561928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7x2\" (UniqueName: \"kubernetes.io/projected/b79ee471-c4fb-48ad-a09b-91760a1f51b8-kube-api-access-vm7x2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.562167 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.561968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.562167 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.562023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.562408 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.562391 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.562480 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.562456 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.572370 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.572339 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7x2\" (UniqueName: \"kubernetes.io/projected/b79ee471-c4fb-48ad-a09b-91760a1f51b8-kube-api-access-vm7x2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.647022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.646934 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:07.786321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.786299 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v"] Jul 07 02:25:07.788963 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:25:07.788937 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79ee471_c4fb_48ad_a09b_91760a1f51b8.slice/crio-7fd3c164ce7f9554ce4c1f41e33ab3a0ef8b6cac3aa5f68f63eaca5838791d82 WatchSource:0}: Error finding container 7fd3c164ce7f9554ce4c1f41e33ab3a0ef8b6cac3aa5f68f63eaca5838791d82: Status 404 returned error can't find the container with id 7fd3c164ce7f9554ce4c1f41e33ab3a0ef8b6cac3aa5f68f63eaca5838791d82 Jul 07 02:25:07.927283 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.927197 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2"] Jul 07 02:25:07.930692 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.930675 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:07.937185 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:07.937152 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2"] Jul 07 02:25:08.067242 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.067206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.067242 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.067249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.067456 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.067320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfqb\" (UniqueName: \"kubernetes.io/projected/21a883a1-9981-4989-b191-75860e37a02a-kube-api-access-ggfqb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.168399 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.168362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.168549 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.168411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.168549 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.168445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfqb\" (UniqueName: \"kubernetes.io/projected/21a883a1-9981-4989-b191-75860e37a02a-kube-api-access-ggfqb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.168792 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.168774 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.168836 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.168798 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.177789 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.177727 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfqb\" (UniqueName: \"kubernetes.io/projected/21a883a1-9981-4989-b191-75860e37a02a-kube-api-access-ggfqb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.264854 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.264819 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:08.328322 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.328279 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp"] Jul 07 02:25:08.332232 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.332207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.338690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.338662 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp"] Jul 07 02:25:08.410014 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.409989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2"] Jul 07 02:25:08.411857 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:25:08.411831 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a883a1_9981_4989_b191_75860e37a02a.slice/crio-c820946001ae0fb29c46d608f116f04a8d2f0663b9f2e267b4cfbd9c96a4cb63 WatchSource:0}: Error finding container c820946001ae0fb29c46d608f116f04a8d2f0663b9f2e267b4cfbd9c96a4cb63: Status 404 returned error can't find the container with id c820946001ae0fb29c46d608f116f04a8d2f0663b9f2e267b4cfbd9c96a4cb63 Jul 07 02:25:08.419219 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.419196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" event={"ID":"21a883a1-9981-4989-b191-75860e37a02a","Type":"ContainerStarted","Data":"c820946001ae0fb29c46d608f116f04a8d2f0663b9f2e267b4cfbd9c96a4cb63"} Jul 07 02:25:08.420865 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.420838 2556 generic.go:356] "Generic (PLEG): container finished" podID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerID="a983a0bd66c1e9dca95c10ec2acbdc22399ff72fe9625d741a98d835acc2eac4" exitCode=0 Jul 07 02:25:08.420967 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.420923 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" event={"ID":"b79ee471-c4fb-48ad-a09b-91760a1f51b8","Type":"ContainerDied","Data":"a983a0bd66c1e9dca95c10ec2acbdc22399ff72fe9625d741a98d835acc2eac4"} Jul 07 02:25:08.421027 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.420975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" event={"ID":"b79ee471-c4fb-48ad-a09b-91760a1f51b8","Type":"ContainerStarted","Data":"7fd3c164ce7f9554ce4c1f41e33ab3a0ef8b6cac3aa5f68f63eaca5838791d82"} Jul 07 02:25:08.421357 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.421343 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:25:08.470877 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.470853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7fv\" (UniqueName: \"kubernetes.io/projected/eab19e08-aa68-487f-89ca-829b668c1967-kube-api-access-hn7fv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.470981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.470893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.470981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.470977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.571886 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.571843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.572164 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.571937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.572164 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.572034 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7fv\" (UniqueName: \"kubernetes.io/projected/eab19e08-aa68-487f-89ca-829b668c1967-kube-api-access-hn7fv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.572303 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.572286 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.572356 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.572299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.579856 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.579823 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7fv\" (UniqueName: \"kubernetes.io/projected/eab19e08-aa68-487f-89ca-829b668c1967-kube-api-access-hn7fv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.643815 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.643766 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:08.719774 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.719742 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b"] Jul 07 02:25:08.723669 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.723652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.730611 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.730538 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b"] Jul 07 02:25:08.787559 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.787534 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp"] Jul 07 02:25:08.789235 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:25:08.789201 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab19e08_aa68_487f_89ca_829b668c1967.slice/crio-7e0d3a61fc1eb01b07500cec5ecacbead6aa5c0670ed57adf5d17a4cedf00480 WatchSource:0}: Error finding container 7e0d3a61fc1eb01b07500cec5ecacbead6aa5c0670ed57adf5d17a4cedf00480: Status 404 returned error can't find the container with id 7e0d3a61fc1eb01b07500cec5ecacbead6aa5c0670ed57adf5d17a4cedf00480 Jul 07 02:25:08.875133 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.875096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.875325 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.875157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qftwm\" (UniqueName: \"kubernetes.io/projected/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-kube-api-access-qftwm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.875325 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.875242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.976469 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.976431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.976687 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.976497 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.976687 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.976529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qftwm\" (UniqueName: \"kubernetes.io/projected/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-kube-api-access-qftwm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.976935 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.976917 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.976989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.976971 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:08.983648 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:08.983612 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qftwm\" (UniqueName: \"kubernetes.io/projected/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-kube-api-access-qftwm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:09.036703 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.036671 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:09.187023 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.186986 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b"] Jul 07 02:25:09.206942 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:25:09.206909 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ab40ac_9c2a_4d9b_ae31_3b2403a7db66.slice/crio-82be5e09f355c67ad2b14bb7aa123c0b50daa545c15f5a94e15d32ebdbf4a3ff WatchSource:0}: Error finding container 82be5e09f355c67ad2b14bb7aa123c0b50daa545c15f5a94e15d32ebdbf4a3ff: Status 404 returned error can't find the container with id 82be5e09f355c67ad2b14bb7aa123c0b50daa545c15f5a94e15d32ebdbf4a3ff Jul 07 02:25:09.427948 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.427907 2556 generic.go:356] "Generic (PLEG): container finished" podID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerID="5c2e4bf616f54ae499c4ae578e7fa553967ccf0aa65cf5ad922117add92fec83" exitCode=0 Jul 07 02:25:09.428403 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.427995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" event={"ID":"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66","Type":"ContainerDied","Data":"5c2e4bf616f54ae499c4ae578e7fa553967ccf0aa65cf5ad922117add92fec83"} Jul 07 02:25:09.428403 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.428052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" event={"ID":"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66","Type":"ContainerStarted","Data":"82be5e09f355c67ad2b14bb7aa123c0b50daa545c15f5a94e15d32ebdbf4a3ff"} Jul 07 02:25:09.429612 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.429589 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab19e08-aa68-487f-89ca-829b668c1967" containerID="9be5d7c1274e0c87b56f8a529f6bd1397ac1f770c28d5375c0638eebe0dbfcd0" exitCode=0 Jul 07 02:25:09.429704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.429666 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" event={"ID":"eab19e08-aa68-487f-89ca-829b668c1967","Type":"ContainerDied","Data":"9be5d7c1274e0c87b56f8a529f6bd1397ac1f770c28d5375c0638eebe0dbfcd0"} Jul 07 02:25:09.429770 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.429706 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" event={"ID":"eab19e08-aa68-487f-89ca-829b668c1967","Type":"ContainerStarted","Data":"7e0d3a61fc1eb01b07500cec5ecacbead6aa5c0670ed57adf5d17a4cedf00480"} Jul 07 02:25:09.431464 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.431434 2556 generic.go:356] "Generic (PLEG): container finished" podID="21a883a1-9981-4989-b191-75860e37a02a" containerID="79373b0631e72ac89af2b488fc0d4f2153ec668eae54c1c34b23c947abc85029" exitCode=0 Jul 07 02:25:09.431557 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.431489 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" event={"ID":"21a883a1-9981-4989-b191-75860e37a02a","Type":"ContainerDied","Data":"79373b0631e72ac89af2b488fc0d4f2153ec668eae54c1c34b23c947abc85029"} Jul 07 02:25:09.433617 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.433499 2556 generic.go:356] "Generic (PLEG): container finished" podID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerID="cd3143b08ca31b780c24609a6cd50673bf5674fa5dc44d5f7b3fd4f540bf6ef5" exitCode=0 Jul 07 02:25:09.433617 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:09.433542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" event={"ID":"b79ee471-c4fb-48ad-a09b-91760a1f51b8","Type":"ContainerDied","Data":"cd3143b08ca31b780c24609a6cd50673bf5674fa5dc44d5f7b3fd4f540bf6ef5"} Jul 07 02:25:10.449296 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:10.448989 2556 generic.go:356] "Generic (PLEG): container finished" podID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerID="8cb55e43f68111a81bea9f07b9360fcde608abfd17cc972df543df9c3dc97010" exitCode=0 Jul 07 02:25:10.449296 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:10.449092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" event={"ID":"b79ee471-c4fb-48ad-a09b-91760a1f51b8","Type":"ContainerDied","Data":"8cb55e43f68111a81bea9f07b9360fcde608abfd17cc972df543df9c3dc97010"} Jul 07 02:25:10.497772 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:25:10.497736 2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ab40ac_9c2a_4d9b_ae31_3b2403a7db66.slice/crio-conmon-3ce5f4472083bba02c39d5e86a3bf1f2e1ec6b2ef829235f4cdc565a260eab37.scope\": RecentStats: unable to find data in memory cache]" Jul 07 02:25:11.461172 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.461139 2556 generic.go:356] "Generic (PLEG): container finished" podID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerID="3ce5f4472083bba02c39d5e86a3bf1f2e1ec6b2ef829235f4cdc565a260eab37" exitCode=0 Jul 07 02:25:11.461581 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.461212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" event={"ID":"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66","Type":"ContainerDied","Data":"3ce5f4472083bba02c39d5e86a3bf1f2e1ec6b2ef829235f4cdc565a260eab37"} Jul 07 02:25:11.463034 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.462996 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab19e08-aa68-487f-89ca-829b668c1967" containerID="5f743e793bf36033370fe4d5ca87098732cadc7af44c462780c6c8ff08d9d664" exitCode=0 Jul 07 02:25:11.463122 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.463080 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" event={"ID":"eab19e08-aa68-487f-89ca-829b668c1967","Type":"ContainerDied","Data":"5f743e793bf36033370fe4d5ca87098732cadc7af44c462780c6c8ff08d9d664"} Jul 07 02:25:11.465222 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.465203 2556 generic.go:356] "Generic (PLEG): container finished" podID="21a883a1-9981-4989-b191-75860e37a02a" containerID="d3a12844ad3d692a206b1ed2fe7d1d91292526dda46fb29d9819e3abbefe6602" exitCode=0 Jul 07 02:25:11.465321 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.465286 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" event={"ID":"21a883a1-9981-4989-b191-75860e37a02a","Type":"ContainerDied","Data":"d3a12844ad3d692a206b1ed2fe7d1d91292526dda46fb29d9819e3abbefe6602"} Jul 07 02:25:11.620535 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.620498 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:11.699764 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.699731 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-util\") pod \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " Jul 07 02:25:11.699951 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.699837 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-bundle\") pod \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " Jul 07 02:25:11.699951 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.699863 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm7x2\" (UniqueName: \"kubernetes.io/projected/b79ee471-c4fb-48ad-a09b-91760a1f51b8-kube-api-access-vm7x2\") pod \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\" (UID: \"b79ee471-c4fb-48ad-a09b-91760a1f51b8\") " Jul 07 02:25:11.700436 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.700406 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-bundle" (OuterVolumeSpecName: "bundle") pod "b79ee471-c4fb-48ad-a09b-91760a1f51b8" (UID: "b79ee471-c4fb-48ad-a09b-91760a1f51b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:11.702226 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.702202 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b79ee471-c4fb-48ad-a09b-91760a1f51b8-kube-api-access-vm7x2" (OuterVolumeSpecName: "kube-api-access-vm7x2") pod "b79ee471-c4fb-48ad-a09b-91760a1f51b8" (UID: "b79ee471-c4fb-48ad-a09b-91760a1f51b8"). InnerVolumeSpecName "kube-api-access-vm7x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:25:11.704846 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.704822 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-util" (OuterVolumeSpecName: "util") pod "b79ee471-c4fb-48ad-a09b-91760a1f51b8" (UID: "b79ee471-c4fb-48ad-a09b-91760a1f51b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:11.800900 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.800864 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:11.800900 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.800895 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79ee471-c4fb-48ad-a09b-91760a1f51b8-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:11.800900 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:11.800905 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm7x2\" (UniqueName: \"kubernetes.io/projected/b79ee471-c4fb-48ad-a09b-91760a1f51b8-kube-api-access-vm7x2\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:12.471502 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.471470 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" Jul 07 02:25:12.471502 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.471483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v" event={"ID":"b79ee471-c4fb-48ad-a09b-91760a1f51b8","Type":"ContainerDied","Data":"7fd3c164ce7f9554ce4c1f41e33ab3a0ef8b6cac3aa5f68f63eaca5838791d82"} Jul 07 02:25:12.471959 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.471555 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fd3c164ce7f9554ce4c1f41e33ab3a0ef8b6cac3aa5f68f63eaca5838791d82" Jul 07 02:25:12.473706 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.473677 2556 generic.go:356] "Generic (PLEG): container finished" podID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerID="39dfe6806f8bf2d24ba0bc41d3d49c804deb174c7a45add7f68c7e8c067d89c3" exitCode=0 Jul 07 02:25:12.473808 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.473743 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" event={"ID":"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66","Type":"ContainerDied","Data":"39dfe6806f8bf2d24ba0bc41d3d49c804deb174c7a45add7f68c7e8c067d89c3"} Jul 07 02:25:12.475883 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.475862 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab19e08-aa68-487f-89ca-829b668c1967" containerID="8c033d86136434197c3222de1336685339a13d0ce72559810506206a8ecdcd52" exitCode=0 Jul 07 02:25:12.475964 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.475933 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" event={"ID":"eab19e08-aa68-487f-89ca-829b668c1967","Type":"ContainerDied","Data":"8c033d86136434197c3222de1336685339a13d0ce72559810506206a8ecdcd52"} Jul 07 02:25:12.478070 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.478051 2556 generic.go:356] "Generic (PLEG): container finished" podID="21a883a1-9981-4989-b191-75860e37a02a" containerID="5a49d9c003c393edf6314a9bcbda20125b4e87736997dd00c6fb1fdd89cb8154" exitCode=0 Jul 07 02:25:12.478170 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:12.478083 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" event={"ID":"21a883a1-9981-4989-b191-75860e37a02a","Type":"ContainerDied","Data":"5a49d9c003c393edf6314a9bcbda20125b4e87736997dd00c6fb1fdd89cb8154"} Jul 07 02:25:13.672584 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.672527 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:13.683526 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.683504 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:13.686895 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.686872 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:13.822381 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822279 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn7fv\" (UniqueName: \"kubernetes.io/projected/eab19e08-aa68-487f-89ca-829b668c1967-kube-api-access-hn7fv\") pod \"eab19e08-aa68-487f-89ca-829b668c1967\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " Jul 07 02:25:13.822381 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822336 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-bundle\") pod \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822384 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-util\") pod \"21a883a1-9981-4989-b191-75860e37a02a\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822413 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qftwm\" (UniqueName: \"kubernetes.io/projected/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-kube-api-access-qftwm\") pod \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822455 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-util\") pod \"eab19e08-aa68-487f-89ca-829b668c1967\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822479 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-bundle\") pod \"eab19e08-aa68-487f-89ca-829b668c1967\" (UID: \"eab19e08-aa68-487f-89ca-829b668c1967\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822508 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-util\") pod \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\" (UID: \"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822545 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggfqb\" (UniqueName: \"kubernetes.io/projected/21a883a1-9981-4989-b191-75860e37a02a-kube-api-access-ggfqb\") pod \"21a883a1-9981-4989-b191-75860e37a02a\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " Jul 07 02:25:13.822596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822575 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-bundle\") pod \"21a883a1-9981-4989-b191-75860e37a02a\" (UID: \"21a883a1-9981-4989-b191-75860e37a02a\") " Jul 07 02:25:13.822958 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.822939 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-bundle" (OuterVolumeSpecName: "bundle") pod "31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" (UID: "31ab40ac-9c2a-4d9b-ae31-3b2403a7db66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:13.823662 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.823591 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-bundle" (OuterVolumeSpecName: "bundle") pod "21a883a1-9981-4989-b191-75860e37a02a" (UID: "21a883a1-9981-4989-b191-75860e37a02a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:13.823815 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.823678 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-bundle" (OuterVolumeSpecName: "bundle") pod "eab19e08-aa68-487f-89ca-829b668c1967" (UID: "eab19e08-aa68-487f-89ca-829b668c1967"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:13.825216 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.825183 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-kube-api-access-qftwm" (OuterVolumeSpecName: "kube-api-access-qftwm") pod "31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" (UID: "31ab40ac-9c2a-4d9b-ae31-3b2403a7db66"). InnerVolumeSpecName "kube-api-access-qftwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:25:13.825290 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.825274 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab19e08-aa68-487f-89ca-829b668c1967-kube-api-access-hn7fv" (OuterVolumeSpecName: "kube-api-access-hn7fv") pod "eab19e08-aa68-487f-89ca-829b668c1967" (UID: "eab19e08-aa68-487f-89ca-829b668c1967"). InnerVolumeSpecName "kube-api-access-hn7fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:25:13.825290 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.825266 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a883a1-9981-4989-b191-75860e37a02a-kube-api-access-ggfqb" (OuterVolumeSpecName: "kube-api-access-ggfqb") pod "21a883a1-9981-4989-b191-75860e37a02a" (UID: "21a883a1-9981-4989-b191-75860e37a02a"). InnerVolumeSpecName "kube-api-access-ggfqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:25:13.829659 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.829614 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-util" (OuterVolumeSpecName: "util") pod "31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" (UID: "31ab40ac-9c2a-4d9b-ae31-3b2403a7db66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:13.829732 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.829654 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-util" (OuterVolumeSpecName: "util") pod "eab19e08-aa68-487f-89ca-829b668c1967" (UID: "eab19e08-aa68-487f-89ca-829b668c1967"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:13.867976 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.867941 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-util" (OuterVolumeSpecName: "util") pod "21a883a1-9981-4989-b191-75860e37a02a" (UID: "21a883a1-9981-4989-b191-75860e37a02a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:25:13.924098 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924059 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924098 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924100 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qftwm\" (UniqueName: \"kubernetes.io/projected/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-kube-api-access-qftwm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924112 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924121 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eab19e08-aa68-487f-89ca-829b668c1967-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924129 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-util\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924136 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggfqb\" (UniqueName: \"kubernetes.io/projected/21a883a1-9981-4989-b191-75860e37a02a-kube-api-access-ggfqb\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924144 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21a883a1-9981-4989-b191-75860e37a02a-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924152 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn7fv\" (UniqueName: \"kubernetes.io/projected/eab19e08-aa68-487f-89ca-829b668c1967-kube-api-access-hn7fv\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:13.924282 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:13.924159 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ab40ac-9c2a-4d9b-ae31-3b2403a7db66-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:25:14.490007 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.489969 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" event={"ID":"31ab40ac-9c2a-4d9b-ae31-3b2403a7db66","Type":"ContainerDied","Data":"82be5e09f355c67ad2b14bb7aa123c0b50daa545c15f5a94e15d32ebdbf4a3ff"} Jul 07 02:25:14.490164 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.490025 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82be5e09f355c67ad2b14bb7aa123c0b50daa545c15f5a94e15d32ebdbf4a3ff" Jul 07 02:25:14.490164 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.489981 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b" Jul 07 02:25:14.491984 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.491955 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" Jul 07 02:25:14.492113 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.491957 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp" event={"ID":"eab19e08-aa68-487f-89ca-829b668c1967","Type":"ContainerDied","Data":"7e0d3a61fc1eb01b07500cec5ecacbead6aa5c0670ed57adf5d17a4cedf00480"} Jul 07 02:25:14.492113 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.492090 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e0d3a61fc1eb01b07500cec5ecacbead6aa5c0670ed57adf5d17a4cedf00480" Jul 07 02:25:14.493967 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.493947 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" Jul 07 02:25:14.494065 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.493956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2" event={"ID":"21a883a1-9981-4989-b191-75860e37a02a","Type":"ContainerDied","Data":"c820946001ae0fb29c46d608f116f04a8d2f0663b9f2e267b4cfbd9c96a4cb63"} Jul 07 02:25:14.494065 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:14.494007 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c820946001ae0fb29c46d608f116f04a8d2f0663b9f2e267b4cfbd9c96a4cb63" Jul 07 02:25:28.773505 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:28.773468 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:31.732746 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:31.732712 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:32.554653 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.554609 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:32.977096 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977058 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbc565f57-q8sdw"] Jul 07 02:25:32.977588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977542 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="util" Jul 07 02:25:32.977588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977563 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="util" Jul 07 02:25:32.977588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977579 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="extract" Jul 07 02:25:32.977588 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977587 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977601 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="util" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977610 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="util" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977618 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="util" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977628 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="util" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977657 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977666 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977679 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977688 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977708 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="util" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977716 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="util" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977728 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977736 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977745 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977753 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977771 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977779 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977789 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977797 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="extract" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977809 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="pull" Jul 07 02:25:32.977858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977817 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="pull" Jul 07 02:25:32.978820 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977912 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b79ee471-c4fb-48ad-a09b-91760a1f51b8" containerName="extract" Jul 07 02:25:32.978820 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977924 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab19e08-aa68-487f-89ca-829b668c1967" containerName="extract" Jul 07 02:25:32.978820 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977934 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="21a883a1-9981-4989-b191-75860e37a02a" containerName="extract" Jul 07 02:25:32.978820 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.977944 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab40ac-9c2a-4d9b-ae31-3b2403a7db66" containerName="extract" Jul 07 02:25:32.981341 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.981319 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:32.991302 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:32.991277 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbc565f57-q8sdw"] Jul 07 02:25:33.048399 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.048327 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:33.089380 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-config\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.089567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-serving-cert\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.089567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7q5z\" (UniqueName: \"kubernetes.io/projected/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-kube-api-access-l7q5z\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.089567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-service-ca\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.089567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-oauth-config\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.089567 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-trusted-ca-bundle\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.089793 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.089576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-oauth-serving-cert\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.145035 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.145000 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:33.190287 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-config\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.190480 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-serving-cert\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.190480 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7q5z\" (UniqueName: \"kubernetes.io/projected/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-kube-api-access-l7q5z\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.190480 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-service-ca\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.190480 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-oauth-config\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.190480 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-trusted-ca-bundle\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.190791 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.190484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-oauth-serving-cert\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.191197 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.191167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-service-ca\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.191322 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.191167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-config\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.191450 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.191412 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-oauth-serving-cert\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.191450 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.191426 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-trusted-ca-bundle\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.193089 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.193061 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-oauth-config\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.193177 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.193061 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-console-serving-cert\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.204314 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.204290 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7q5z\" (UniqueName: \"kubernetes.io/projected/077a7af1-7582-48ff-a0d0-2ba6b8aae2df-kube-api-access-l7q5z\") pod \"console-6fbc565f57-q8sdw\" (UID: \"077a7af1-7582-48ff-a0d0-2ba6b8aae2df\") " pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.293244 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.293145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:33.295198 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.295171 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:33.384607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.384567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:33.442135 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.442111 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbc565f57-q8sdw"] Jul 07 02:25:33.444365 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:25:33.444341 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077a7af1_7582_48ff_a0d0_2ba6b8aae2df.slice/crio-0847318fe5e4f55c82fd054ceaed1ca2861cd85c0f98cb3d4995422f4b74562b WatchSource:0}: Error finding container 0847318fe5e4f55c82fd054ceaed1ca2861cd85c0f98cb3d4995422f4b74562b: Status 404 returned error can't find the container with id 0847318fe5e4f55c82fd054ceaed1ca2861cd85c0f98cb3d4995422f4b74562b Jul 07 02:25:33.597866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.597788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbc565f57-q8sdw" event={"ID":"077a7af1-7582-48ff-a0d0-2ba6b8aae2df","Type":"ContainerStarted","Data":"4c4c011f39870f06ce8e60348f39687cf6758ecab1041f1d822c42bd8b8056c8"} Jul 07 02:25:33.597866 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.597835 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbc565f57-q8sdw" event={"ID":"077a7af1-7582-48ff-a0d0-2ba6b8aae2df","Type":"ContainerStarted","Data":"0847318fe5e4f55c82fd054ceaed1ca2861cd85c0f98cb3d4995422f4b74562b"} Jul 07 02:25:33.624156 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.621074 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbc565f57-q8sdw" podStartSLOduration=1.621053944 podStartE2EDuration="1.621053944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:33.617031294 +0000 UTC m=+635.112055824" watchObservedRunningTime="2026-07-07 02:25:33.621053944 +0000 UTC m=+635.116078476" Jul 07 02:25:33.782390 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.782359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:33.882768 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:33.882679 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:35.998358 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:35.998313 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:37.091201 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:37.091165 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:38.813253 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:38.813219 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:40.104194 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:40.104162 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:41.145744 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:41.145707 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:42.216548 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:42.216503 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:43.293471 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.293428 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:43.293950 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.293500 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:43.298490 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.298463 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:43.657829 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.657751 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbc565f57-q8sdw" Jul 07 02:25:43.724355 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.724319 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7856d7d968-8pjx6"] Jul 07 02:25:43.858671 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.858628 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:43.930121 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.930021 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:43.996542 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:43.996507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:44.837182 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:44.837151 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:44.932816 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:44.932773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:49.699856 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.699810 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq"] Jul 07 02:25:49.704971 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.704947 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.706982 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.706957 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 02:25:49.706982 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.706977 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 02:25:49.707173 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.706957 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 02:25:49.707441 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.707425 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 02:25:49.707485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.707435 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7mtwz\"" Jul 07 02:25:49.711887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.711847 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:49.712531 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.712508 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq"] Jul 07 02:25:49.811597 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.811563 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:49.844239 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.844204 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3c677e5-b562-40bc-a7b5-b15faa693e1d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.844525 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.844255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhrpl\" (UniqueName: \"kubernetes.io/projected/b3c677e5-b562-40bc-a7b5-b15faa693e1d-kube-api-access-fhrpl\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.844525 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.844371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3c677e5-b562-40bc-a7b5-b15faa693e1d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.945523 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.945482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3c677e5-b562-40bc-a7b5-b15faa693e1d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.945734 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.945536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhrpl\" (UniqueName: \"kubernetes.io/projected/b3c677e5-b562-40bc-a7b5-b15faa693e1d-kube-api-access-fhrpl\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.945734 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.945579 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3c677e5-b562-40bc-a7b5-b15faa693e1d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.946229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.946200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3c677e5-b562-40bc-a7b5-b15faa693e1d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.948192 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.948172 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3c677e5-b562-40bc-a7b5-b15faa693e1d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:49.954283 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:49.954208 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhrpl\" (UniqueName: \"kubernetes.io/projected/b3c677e5-b562-40bc-a7b5-b15faa693e1d-kube-api-access-fhrpl\") pod \"kuadrant-console-plugin-66b5774985-w7fzq\" (UID: \"b3c677e5-b562-40bc-a7b5-b15faa693e1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:50.016362 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.016325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" Jul 07 02:25:50.172656 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.172612 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq"] Jul 07 02:25:50.175018 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:25:50.174989 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3c677e5_b562_40bc_a7b5_b15faa693e1d.slice/crio-4325026994bc56a35e35784953d13283b7d6ee0ba5af4b0114ad0e6a9c7572f7 WatchSource:0}: Error finding container 4325026994bc56a35e35784953d13283b7d6ee0ba5af4b0114ad0e6a9c7572f7: Status 404 returned error can't find the container with id 4325026994bc56a35e35784953d13283b7d6ee0ba5af4b0114ad0e6a9c7572f7 Jul 07 02:25:50.337870 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.337837 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:50.442501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.442469 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:50.689701 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.689589 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" event={"ID":"b3c677e5-b562-40bc-a7b5-b15faa693e1d","Type":"ContainerStarted","Data":"4325026994bc56a35e35784953d13283b7d6ee0ba5af4b0114ad0e6a9c7572f7"} Jul 07 02:25:50.738017 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.737976 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:50.794533 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:50.794493 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:52.288484 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:52.288426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:52.349536 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:52.349506 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:54.350768 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:54.350701 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:54.425543 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:25:54.425511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:00.843396 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:00.843362 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:00.932286 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:00.932250 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:03.435946 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:03.435914 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:03.532460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:03.532426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:08.749883 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:08.749832 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7856d7d968-8pjx6" podUID="3d1d06e8-f6b0-4cf3-9b23-1728345097e7" containerName="console" containerID="cri-o://b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5" gracePeriod=15 Jul 07 02:26:08.838525 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:08.838496 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:08.938860 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:08.938828 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:09.212046 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:09.212008 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:09.312364 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:09.312322 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:12.832881 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:12.832839 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:12.928369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:12.928334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:13.510596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.510561 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:26:13.571315 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571279 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-trusted-ca-bundle\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571315 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571317 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-config\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571342 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-oauth-config\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571388 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-service-ca\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571414 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2wst\" (UniqueName: \"kubernetes.io/projected/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-kube-api-access-v2wst\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571764 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571584 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-oauth-serving-cert\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571764 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571629 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-serving-cert\") pod \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\" (UID: \"3d1d06e8-f6b0-4cf3-9b23-1728345097e7\") " Jul 07 02:26:13.571764 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571746 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-config" (OuterVolumeSpecName: "console-config") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:26:13.571931 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571824 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:26:13.571931 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.571917 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:26:13.572045 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.572027 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:26:13.572126 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.572107 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-trusted-ca-bundle\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.572171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.572134 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.572171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.572149 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-service-ca\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.572171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.572162 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-oauth-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.573733 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.573704 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:26:13.573886 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.573865 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:26:13.574006 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.573991 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-kube-api-access-v2wst" (OuterVolumeSpecName: "kube-api-access-v2wst") pod "3d1d06e8-f6b0-4cf3-9b23-1728345097e7" (UID: "3d1d06e8-f6b0-4cf3-9b23-1728345097e7"). InnerVolumeSpecName "kube-api-access-v2wst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:26:13.673092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.673000 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2wst\" (UniqueName: \"kubernetes.io/projected/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-kube-api-access-v2wst\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.673092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.673037 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-serving-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.673092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.673046 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d1d06e8-f6b0-4cf3-9b23-1728345097e7-console-oauth-config\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:26:13.851301 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.851269 2556 generic.go:356] "Generic (PLEG): container finished" podID="3d1d06e8-f6b0-4cf3-9b23-1728345097e7" containerID="b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5" exitCode=0 Jul 07 02:26:13.851710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.851322 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7856d7d968-8pjx6" Jul 07 02:26:13.851710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.851351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7856d7d968-8pjx6" event={"ID":"3d1d06e8-f6b0-4cf3-9b23-1728345097e7","Type":"ContainerDied","Data":"b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5"} Jul 07 02:26:13.851710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.851407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7856d7d968-8pjx6" event={"ID":"3d1d06e8-f6b0-4cf3-9b23-1728345097e7","Type":"ContainerDied","Data":"d8c86030b0daf76d2f45537c57cb5947401faa0b34009242cae6251c0c27e0ee"} Jul 07 02:26:13.851710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.851427 2556 scope.go:117] "RemoveContainer" containerID="b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5" Jul 07 02:26:13.860607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.860586 2556 scope.go:117] "RemoveContainer" containerID="b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5" Jul 07 02:26:13.860935 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:26:13.860917 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5\": container with ID starting with b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5 not found: ID does not exist" containerID="b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5" Jul 07 02:26:13.860980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.860947 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5"} err="failed to get container status \"b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5\": rpc error: code = NotFound desc = could not find container \"b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5\": container with ID starting with b99517357dfdbad713113a5114c6f7791cf938eb6a94d5826817e3911d1e45a5 not found: ID does not exist" Jul 07 02:26:13.877270 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.877231 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7856d7d968-8pjx6"] Jul 07 02:26:13.881490 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:13.881462 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7856d7d968-8pjx6"] Jul 07 02:26:14.858116 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:14.858080 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" event={"ID":"b3c677e5-b562-40bc-a7b5-b15faa693e1d","Type":"ContainerStarted","Data":"41e312464af3560926ceda3618eedf2a9fa249c7b5f681a93e4192fd7fdd4b57"} Jul 07 02:26:14.874607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:14.874545 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w7fzq" podStartSLOduration=2.275056284 podStartE2EDuration="25.874527824s" totalImagesPullingTime="23.59947154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:14.872537796 +0000 UTC m=+676.367562327" watchObservedRunningTime="2026-07-07 02:26:14.874527824 +0000 UTC m=+676.369552355" Jul 07 02:26:15.042668 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:15.042614 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1d06e8-f6b0-4cf3-9b23-1728345097e7" path="/var/lib/kubelet/pods/3d1d06e8-f6b0-4cf3-9b23-1728345097e7/volumes" Jul 07 02:26:19.276606 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:19.276570 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:19.375367 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:19.375337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:30.103328 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:30.103287 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:30.270230 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:30.270194 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:44.921341 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:44.921309 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:45.022617 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.022559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:45.124977 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.124941 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:45.345432 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.345393 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:26:45.345857 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.345839 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1d06e8-f6b0-4cf3-9b23-1728345097e7" containerName="console" Jul 07 02:26:45.345980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.345862 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1d06e8-f6b0-4cf3-9b23-1728345097e7" containerName="console" Jul 07 02:26:45.345980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.345947 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1d06e8-f6b0-4cf3-9b23-1728345097e7" containerName="console" Jul 07 02:26:45.426920 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.426875 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:26:45.426920 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.426927 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:26:45.427157 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.426969 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.429340 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.429314 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 02:26:45.552563 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.552526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rr8g\" (UniqueName: \"kubernetes.io/projected/9e272336-2774-40a3-8124-359e17815c26-kube-api-access-2rr8g\") pod \"limitador-limitador-54d6d988d5-rpptr\" (UID: \"9e272336-2774-40a3-8124-359e17815c26\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.552766 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.552591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e272336-2774-40a3-8124-359e17815c26-config-file\") pod \"limitador-limitador-54d6d988d5-rpptr\" (UID: \"9e272336-2774-40a3-8124-359e17815c26\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.653906 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.653815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rr8g\" (UniqueName: \"kubernetes.io/projected/9e272336-2774-40a3-8124-359e17815c26-kube-api-access-2rr8g\") pod \"limitador-limitador-54d6d988d5-rpptr\" (UID: \"9e272336-2774-40a3-8124-359e17815c26\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.653906 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.653874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e272336-2774-40a3-8124-359e17815c26-config-file\") pod \"limitador-limitador-54d6d988d5-rpptr\" (UID: \"9e272336-2774-40a3-8124-359e17815c26\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.654556 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.654535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e272336-2774-40a3-8124-359e17815c26-config-file\") pod \"limitador-limitador-54d6d988d5-rpptr\" (UID: \"9e272336-2774-40a3-8124-359e17815c26\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.662675 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.662619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rr8g\" (UniqueName: \"kubernetes.io/projected/9e272336-2774-40a3-8124-359e17815c26-kube-api-access-2rr8g\") pod \"limitador-limitador-54d6d988d5-rpptr\" (UID: \"9e272336-2774-40a3-8124-359e17815c26\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.737864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.737832 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:45.770925 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.770893 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:45.836972 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.836937 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:45.865658 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.865557 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4hh9d"] Jul 07 02:26:45.876152 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.876121 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4hh9d"] Jul 07 02:26:45.876323 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.876238 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:26:45.879144 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.879101 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxxrr\"" Jul 07 02:26:45.906417 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.906395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:26:45.908403 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:26:45.908371 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e272336_2774_40a3_8124_359e17815c26.slice/crio-5970ee5ee7791636ee2605e0283b751cad8391ab9d295b4f43a1d027d7819a58 WatchSource:0}: Error finding container 5970ee5ee7791636ee2605e0283b751cad8391ab9d295b4f43a1d027d7819a58: Status 404 returned error can't find the container with id 5970ee5ee7791636ee2605e0283b751cad8391ab9d295b4f43a1d027d7819a58 Jul 07 02:26:45.956800 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:45.956763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwcrn\" (UniqueName: \"kubernetes.io/projected/92966d41-bb26-474b-8510-98708cd009ba-kube-api-access-rwcrn\") pod \"authorino-75d556bd77-4hh9d\" (UID: \"92966d41-bb26-474b-8510-98708cd009ba\") " pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:26:46.030737 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:46.030701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" event={"ID":"9e272336-2774-40a3-8124-359e17815c26","Type":"ContainerStarted","Data":"5970ee5ee7791636ee2605e0283b751cad8391ab9d295b4f43a1d027d7819a58"} Jul 07 02:26:46.057821 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:46.057786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwcrn\" (UniqueName: \"kubernetes.io/projected/92966d41-bb26-474b-8510-98708cd009ba-kube-api-access-rwcrn\") pod \"authorino-75d556bd77-4hh9d\" (UID: \"92966d41-bb26-474b-8510-98708cd009ba\") " pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:26:46.066590 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:46.066565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwcrn\" (UniqueName: \"kubernetes.io/projected/92966d41-bb26-474b-8510-98708cd009ba-kube-api-access-rwcrn\") pod \"authorino-75d556bd77-4hh9d\" (UID: \"92966d41-bb26-474b-8510-98708cd009ba\") " pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:26:46.188855 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:46.188757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:26:46.345867 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:46.345833 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4hh9d"] Jul 07 02:26:46.348150 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:26:46.348120 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92966d41_bb26_474b_8510_98708cd009ba.slice/crio-d5d9010c940d19b1871476b17f74f27ae62f24ae847841fb4f29635880109497 WatchSource:0}: Error finding container d5d9010c940d19b1871476b17f74f27ae62f24ae847841fb4f29635880109497: Status 404 returned error can't find the container with id d5d9010c940d19b1871476b17f74f27ae62f24ae847841fb4f29635880109497 Jul 07 02:26:47.045422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:47.045362 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4hh9d" event={"ID":"92966d41-bb26-474b-8510-98708cd009ba","Type":"ContainerStarted","Data":"d5d9010c940d19b1871476b17f74f27ae62f24ae847841fb4f29635880109497"} Jul 07 02:26:51.072608 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:51.072571 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4hh9d" event={"ID":"92966d41-bb26-474b-8510-98708cd009ba","Type":"ContainerStarted","Data":"0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5"} Jul 07 02:26:51.074156 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:51.074127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" event={"ID":"9e272336-2774-40a3-8124-359e17815c26","Type":"ContainerStarted","Data":"7034be7982e498f8ae6de8eef22476be0034cfdc7a42d4dcd505a7a851dac9d8"} Jul 07 02:26:51.074299 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:51.074266 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:26:51.087930 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:51.087879 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4hh9d" podStartSLOduration=2.048206866 podStartE2EDuration="6.087862424s" totalImagesPullingTime="4.039655558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:51.085797495 +0000 UTC m=+712.580822028" watchObservedRunningTime="2026-07-07 02:26:51.087862424 +0000 UTC m=+712.582886956" Jul 07 02:26:51.103217 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:26:51.103160 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" podStartSLOduration=1.6264652910000001 podStartE2EDuration="6.103143542s" totalImagesPullingTime="4.476678251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:51.100357527 +0000 UTC m=+712.595382058" watchObservedRunningTime="2026-07-07 02:26:51.103143542 +0000 UTC m=+712.598168073" Jul 07 02:27:02.080421 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:02.080387 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rpptr" Jul 07 02:27:06.638215 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:06.638186 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:07.679259 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:07.679225 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:07.752173 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:07.752140 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:19.400613 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:19.400576 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:19.980894 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:19.980858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:20.300215 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.300130 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dcfb8786-9llcd"] Jul 07 02:27:20.304965 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.304944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.307212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.307189 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 02:27:20.311311 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.311287 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dcfb8786-9llcd"] Jul 07 02:27:20.334705 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.334665 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-tls-cert\") pod \"authorino-5dcfb8786-9llcd\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.334705 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.334709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sz48\" (UniqueName: \"kubernetes.io/projected/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-kube-api-access-8sz48\") pod \"authorino-5dcfb8786-9llcd\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.435801 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.435766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-tls-cert\") pod \"authorino-5dcfb8786-9llcd\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.435801 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.435800 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sz48\" (UniqueName: \"kubernetes.io/projected/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-kube-api-access-8sz48\") pod \"authorino-5dcfb8786-9llcd\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.438434 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.438405 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-tls-cert\") pod \"authorino-5dcfb8786-9llcd\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.444085 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.444061 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sz48\" (UniqueName: \"kubernetes.io/projected/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-kube-api-access-8sz48\") pod \"authorino-5dcfb8786-9llcd\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.616564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.616467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:27:20.756792 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.756766 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dcfb8786-9llcd"] Jul 07 02:27:20.758959 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:27:20.758917 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a8ff76e_a4c3_47a1_a673_7bf58b0e0aab.slice/crio-f8133fe89f345f526da4979eeebfff28fc068506279e02d46c37ce408bc0ca60 WatchSource:0}: Error finding container f8133fe89f345f526da4979eeebfff28fc068506279e02d46c37ce408bc0ca60: Status 404 returned error can't find the container with id f8133fe89f345f526da4979eeebfff28fc068506279e02d46c37ce408bc0ca60 Jul 07 02:27:20.962529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:20.962502 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:21.234295 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:21.234266 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dcfb8786-9llcd" event={"ID":"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab","Type":"ContainerStarted","Data":"f8133fe89f345f526da4979eeebfff28fc068506279e02d46c37ce408bc0ca60"} Jul 07 02:27:22.241607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.241575 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dcfb8786-9llcd" event={"ID":"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab","Type":"ContainerStarted","Data":"5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4"} Jul 07 02:27:22.257929 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.257874 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dcfb8786-9llcd" podStartSLOduration=1.8498074610000002 podStartE2EDuration="2.257855535s" totalImagesPullingTime="408.048074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:27:22.256289084 +0000 UTC m=+743.751313617" watchObservedRunningTime="2026-07-07 02:27:22.257855535 +0000 UTC m=+743.752880065" Jul 07 02:27:22.285758 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.285717 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4hh9d"] Jul 07 02:27:22.285941 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.285918 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4hh9d" podUID="92966d41-bb26-474b-8510-98708cd009ba" containerName="authorino" containerID="cri-o://0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5" gracePeriod=30 Jul 07 02:27:22.542140 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.542114 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:27:22.657791 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.657752 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwcrn\" (UniqueName: \"kubernetes.io/projected/92966d41-bb26-474b-8510-98708cd009ba-kube-api-access-rwcrn\") pod \"92966d41-bb26-474b-8510-98708cd009ba\" (UID: \"92966d41-bb26-474b-8510-98708cd009ba\") " Jul 07 02:27:22.660049 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.660010 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92966d41-bb26-474b-8510-98708cd009ba-kube-api-access-rwcrn" (OuterVolumeSpecName: "kube-api-access-rwcrn") pod "92966d41-bb26-474b-8510-98708cd009ba" (UID: "92966d41-bb26-474b-8510-98708cd009ba"). InnerVolumeSpecName "kube-api-access-rwcrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:27:22.758424 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:22.758380 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwcrn\" (UniqueName: \"kubernetes.io/projected/92966d41-bb26-474b-8510-98708cd009ba-kube-api-access-rwcrn\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:27:23.247805 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.247769 2556 generic.go:356] "Generic (PLEG): container finished" podID="92966d41-bb26-474b-8510-98708cd009ba" containerID="0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5" exitCode=0 Jul 07 02:27:23.248275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.247834 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4hh9d" Jul 07 02:27:23.248275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.247862 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4hh9d" event={"ID":"92966d41-bb26-474b-8510-98708cd009ba","Type":"ContainerDied","Data":"0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5"} Jul 07 02:27:23.248275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.247910 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4hh9d" event={"ID":"92966d41-bb26-474b-8510-98708cd009ba","Type":"ContainerDied","Data":"d5d9010c940d19b1871476b17f74f27ae62f24ae847841fb4f29635880109497"} Jul 07 02:27:23.248275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.247928 2556 scope.go:117] "RemoveContainer" containerID="0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5" Jul 07 02:27:23.257062 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.257040 2556 scope.go:117] "RemoveContainer" containerID="0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5" Jul 07 02:27:23.257346 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:27:23.257315 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5\": container with ID starting with 0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5 not found: ID does not exist" containerID="0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5" Jul 07 02:27:23.257456 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.257350 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5"} err="failed to get container status \"0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5\": rpc error: code = NotFound desc = could not find container \"0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5\": container with ID starting with 0d96133cf11f1b75e7d0b53f4ba00d7b98a334ae60ea3b6eb1e9f978b9846fe5 not found: ID does not exist" Jul 07 02:27:23.263587 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.263561 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4hh9d"] Jul 07 02:27:23.266754 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:23.266733 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4hh9d"] Jul 07 02:27:25.042847 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:25.042810 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92966d41-bb26-474b-8510-98708cd009ba" path="/var/lib/kubelet/pods/92966d41-bb26-474b-8510-98708cd009ba/volumes" Jul 07 02:27:26.553090 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:26.553055 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:26.649680 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:26.649621 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:26.857256 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:26.857163 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:26.998906 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:26.998874 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:29.757772 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:29.757693 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:29.846573 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:29.846535 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:50.370838 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:50.370787 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:59.357326 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:59.357249 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:59.458989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:27:59.458954 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:02.944816 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:02.944778 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:03.428111 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:03.428076 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:03.656920 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:03.656882 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:03.890096 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:03.890065 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:03.991272 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:03.991240 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:04.157842 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:04.157749 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:28:14.287011 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:14.286958 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:14.384679 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:14.384602 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:23.056350 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:23.056312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:23.510420 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:23.510372 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:28:31.973506 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:31.973445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:32.791117 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:32.791072 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:28:36.729458 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:36.729423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:37.798288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:37.798251 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:28:54.777967 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:54.777912 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:28:56.196251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:28:56.196212 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:29:18.982050 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:29:18.982007 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:29:21.105440 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:29:21.105407 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:29:24.650020 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:29:24.649986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:29:27.503836 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:29:27.503803 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:29:47.848908 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:29:47.848874 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:01.825208 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:01.825065 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:30:01.831093 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:01.826040 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:30:01.831093 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:01.828516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:30:01.831093 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:01.829202 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:30:27.433622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.433585 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55c57b679f-gqtrf"] Jul 07 02:30:27.434019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.433985 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92966d41-bb26-474b-8510-98708cd009ba" containerName="authorino" Jul 07 02:30:27.434019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.433999 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="92966d41-bb26-474b-8510-98708cd009ba" containerName="authorino" Jul 07 02:30:27.434092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.434078 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="92966d41-bb26-474b-8510-98708cd009ba" containerName="authorino" Jul 07 02:30:27.436801 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.436784 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.448080 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.448058 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55c57b679f-gqtrf"] Jul 07 02:30:27.495768 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.495732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzjfp\" (UniqueName: \"kubernetes.io/projected/8a7acb9e-26a6-48a4-9d19-ff7860578dc7-kube-api-access-nzjfp\") pod \"authorino-55c57b679f-gqtrf\" (UID: \"8a7acb9e-26a6-48a4-9d19-ff7860578dc7\") " pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.495945 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.495787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a7acb9e-26a6-48a4-9d19-ff7860578dc7-tls-cert\") pod \"authorino-55c57b679f-gqtrf\" (UID: \"8a7acb9e-26a6-48a4-9d19-ff7860578dc7\") " pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.596841 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.596802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzjfp\" (UniqueName: \"kubernetes.io/projected/8a7acb9e-26a6-48a4-9d19-ff7860578dc7-kube-api-access-nzjfp\") pod \"authorino-55c57b679f-gqtrf\" (UID: \"8a7acb9e-26a6-48a4-9d19-ff7860578dc7\") " pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.597022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.596854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a7acb9e-26a6-48a4-9d19-ff7860578dc7-tls-cert\") pod \"authorino-55c57b679f-gqtrf\" (UID: \"8a7acb9e-26a6-48a4-9d19-ff7860578dc7\") " pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.599382 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.599347 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a7acb9e-26a6-48a4-9d19-ff7860578dc7-tls-cert\") pod \"authorino-55c57b679f-gqtrf\" (UID: \"8a7acb9e-26a6-48a4-9d19-ff7860578dc7\") " pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.605125 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.605098 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzjfp\" (UniqueName: \"kubernetes.io/projected/8a7acb9e-26a6-48a4-9d19-ff7860578dc7-kube-api-access-nzjfp\") pod \"authorino-55c57b679f-gqtrf\" (UID: \"8a7acb9e-26a6-48a4-9d19-ff7860578dc7\") " pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.746251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.746212 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55c57b679f-gqtrf" Jul 07 02:30:27.907340 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.907298 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:27.927595 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.927566 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55c57b679f-gqtrf"] Jul 07 02:30:27.929967 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:30:27.929939 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a7acb9e_26a6_48a4_9d19_ff7860578dc7.slice/crio-40fa47e787be271a9caaa367ac9d43e81ef37fa3f684bf168025dbe3844714b8 WatchSource:0}: Error finding container 40fa47e787be271a9caaa367ac9d43e81ef37fa3f684bf168025dbe3844714b8: Status 404 returned error can't find the container with id 40fa47e787be271a9caaa367ac9d43e81ef37fa3f684bf168025dbe3844714b8 Jul 07 02:30:27.931359 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:27.931342 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:30:28.234022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:28.233975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55c57b679f-gqtrf" event={"ID":"8a7acb9e-26a6-48a4-9d19-ff7860578dc7","Type":"ContainerStarted","Data":"40fa47e787be271a9caaa367ac9d43e81ef37fa3f684bf168025dbe3844714b8"} Jul 07 02:30:29.191577 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.191537 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:29.245139 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.244361 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55c57b679f-gqtrf" event={"ID":"8a7acb9e-26a6-48a4-9d19-ff7860578dc7","Type":"ContainerStarted","Data":"986e4eaf2b48e3225818093b00d77e80031eb56b24d081ccf8527b5dfe5b7862"} Jul 07 02:30:29.279387 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.279328 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55c57b679f-gqtrf" podStartSLOduration=1.82355544 podStartE2EDuration="2.279310214s" totalImagesPullingTime="455.754774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:30:29.276105323 +0000 UTC m=+930.771129855" watchObservedRunningTime="2026-07-07 02:30:29.279310214 +0000 UTC m=+930.774334769" Jul 07 02:30:29.348435 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.348393 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dcfb8786-9llcd"] Jul 07 02:30:29.348674 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.348622 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5dcfb8786-9llcd" podUID="7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" containerName="authorino" containerID="cri-o://5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4" gracePeriod=30 Jul 07 02:30:29.631359 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.631330 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:30:29.715822 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.715734 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-tls-cert\") pod \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " Jul 07 02:30:29.715822 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.715813 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sz48\" (UniqueName: \"kubernetes.io/projected/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-kube-api-access-8sz48\") pod \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\" (UID: \"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab\") " Jul 07 02:30:29.718123 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.718094 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-kube-api-access-8sz48" (OuterVolumeSpecName: "kube-api-access-8sz48") pod "7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" (UID: "7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab"). InnerVolumeSpecName "kube-api-access-8sz48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:30:29.728487 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.728453 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" (UID: "7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:30:29.817051 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.817018 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-tls-cert\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:30:29.817051 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:29.817048 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sz48\" (UniqueName: \"kubernetes.io/projected/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab-kube-api-access-8sz48\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:30:30.253216 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.253180 2556 generic.go:356] "Generic (PLEG): container finished" podID="7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" containerID="5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4" exitCode=0 Jul 07 02:30:30.253739 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.253240 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dcfb8786-9llcd" Jul 07 02:30:30.253739 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.253283 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dcfb8786-9llcd" event={"ID":"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab","Type":"ContainerDied","Data":"5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4"} Jul 07 02:30:30.253739 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.253334 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dcfb8786-9llcd" event={"ID":"7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab","Type":"ContainerDied","Data":"f8133fe89f345f526da4979eeebfff28fc068506279e02d46c37ce408bc0ca60"} Jul 07 02:30:30.253739 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.253357 2556 scope.go:117] "RemoveContainer" containerID="5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4" Jul 07 02:30:30.265285 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.265260 2556 scope.go:117] "RemoveContainer" containerID="5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4" Jul 07 02:30:30.265671 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:30:30.265620 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4\": container with ID starting with 5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4 not found: ID does not exist" containerID="5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4" Jul 07 02:30:30.265771 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.265681 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4"} err="failed to get container status \"5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4\": rpc error: code = NotFound desc = could not find container \"5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4\": container with ID starting with 5bf3a6e74d353294c1e43c23393a5b4bad1ec4f35f4792400f55a5da0d3018a4 not found: ID does not exist" Jul 07 02:30:30.280372 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.280334 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dcfb8786-9llcd"] Jul 07 02:30:30.292062 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:30.292032 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dcfb8786-9llcd"] Jul 07 02:30:31.046833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:31.043472 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" path="/var/lib/kubelet/pods/7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab/volumes" Jul 07 02:30:33.679926 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:33.679894 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:33.751377 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:33.751330 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:56.913492 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:30:56.913449 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:31:06.699892 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:06.699858 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:31:17.391500 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:17.391454 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:31:27.787501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:27.787460 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:31:32.649752 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:32.649686 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:31:37.905241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:37.905150 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:31:40.015427 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:40.015391 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:31:42.036131 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:31:42.036089 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:04.497479 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:04.497439 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:32:15.495957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:15.495918 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:32:20.580829 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:20.580788 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:20.679848 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:20.679812 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:20.804398 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:20.804364 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:27.193951 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:27.193913 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:27.299327 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:27.299288 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:27.395150 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:27.395111 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:27.549160 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:27.549119 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:33.425858 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:33.425817 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:33.510740 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:33.510706 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:49.396811 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:49.396727 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:32:57.487553 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:32:57.487518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:33:07.491770 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:07.491726 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:33:11.187711 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:11.187674 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:33:11.246064 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:11.246021 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:33:13.090599 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:13.090558 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:33:23.895707 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:23.895661 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:33:30.273246 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:30.273188 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:33:35.396853 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:35.396814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:33:46.993552 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:46.993518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:33:56.101564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:33:56.101527 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:34:18.897818 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:34:18.897733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:34:27.982710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:34:27.982673 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:34:50.393997 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:34:50.393955 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:34:52.008770 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:34:52.008735 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:34:52.108780 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:34:52.108746 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:35:00.400726 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:00.400687 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:35:01.863371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:01.863247 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:35:01.875509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:01.874234 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:35:01.875776 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:01.875755 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:35:01.878203 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:01.878180 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:35:17.191707 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:17.191667 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:35:26.997246 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:26.997209 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:35:38.199284 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:38.199247 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:35:47.493574 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:47.493535 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:35:56.604272 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:35:56.604183 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:36:15.377007 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:36:15.376962 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:37:43.189310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:37:43.189275 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:37:53.614212 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:37:53.614165 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:38:02.586022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:38:02.585985 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:38:13.594459 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:38:13.594415 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:38:23.695087 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:38:23.695050 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:38:35.295251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:38:35.295215 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:38:44.401608 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:38:44.401560 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:38:54.088354 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:38:54.088255 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:39:05.095429 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:05.095395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:39:12.223704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:12.223663 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:39:12.309371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:12.309335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:39:15.197800 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:15.197757 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:39:25.388074 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:25.388038 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:39:49.295037 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:49.295002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:39:54.916600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:54.916558 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:39:56.501242 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:39:56.501203 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:40:01.907457 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:01.907312 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:40:01.911583 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:01.910185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:40:01.911583 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:01.910948 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:40:01.913515 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:01.913492 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:40:06.289791 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:06.289752 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:40:16.494310 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:16.494265 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:40:23.910325 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:23.910286 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:40:34.390300 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:34.390254 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:40:45.000017 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:44.999982 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:40:54.095584 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:40:54.095546 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:41:05.288205 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:05.288160 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:41:06.548276 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:06.548229 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:41:06.641763 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:06.641725 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:41:14.293433 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:14.293397 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:41:23.491179 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:23.491143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:41:36.099083 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:36.099040 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:41:45.099074 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:45.099034 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:41:56.091529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:41:56.091447 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:42:05.686122 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:42:05.686083 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:42:17.497426 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:42:17.497387 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:42:27.595275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:42:27.595232 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:42:37.104938 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:42:37.104903 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:42:39.884921 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:42:39.884885 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:42:52.893062 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:42:52.893027 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:43:02.087116 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:02.087079 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:43:04.886796 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:04.886763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:10.261373 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:10.261334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:15.990188 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:15.990150 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:43:18.515102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:18.515063 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:23.593814 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:23.593778 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:26.399876 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:26.399831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:26.501251 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:26.501216 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:26.827912 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:26.827876 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:27.594107 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:27.594068 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:43:32.720514 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:32.720481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:32.788318 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:32.788280 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:32.924984 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:32.924950 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:33.023255 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:33.023168 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.098078 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:34.098022 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.196428 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:34.196396 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.320153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:34.320126 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.734487 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:34.734443 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.833746 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:34.833715 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.933868 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:34.933835 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:36.649375 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:36.649339 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:37.894875 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:37.894844 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:43:39.141921 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:39.141887 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:39.327105 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:39.327070 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:39.429661 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:39.429563 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:39.546403 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:39.546360 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:40.780575 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:40.780536 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:45.187261 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:45.187229 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:45.287957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:45.287925 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:45.393031 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:45.392995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:45.494500 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:45.494463 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:46.492094 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:46.492049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:46.597298 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:46.597265 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:46.692619 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:46.692591 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:46.953088 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:46.953008 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:47.065473 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:47.065440 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:47.182099 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:47.182064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:48.392989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:48.392954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:43:48.695741 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:48.695713 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:51.594416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:51.594382 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:52.000188 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:52.000160 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:57.716422 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:57.716391 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:57.830681 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:43:57.830648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:03.530790 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:03.530757 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:03.635009 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:03.634966 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:03.740600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:03.740563 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:04.720621 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:04.720587 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:04.778125 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:04.778086 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:04.922981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:04.922949 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:05.011094 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:05.011054 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:05.088516 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:05.088483 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:05.400121 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:05.400029 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:05.569058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:05.569025 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:05.669056 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:05.668978 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:07.597339 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:07.597302 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:44:08.282301 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:08.282246 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:09.480740 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:09.480704 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:09.646356 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:09.646319 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:09.747102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:09.747008 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:09.898153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:09.898123 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:10.924239 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:10.924211 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:15.809895 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:15.809853 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:15.910489 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:15.910452 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:16.305380 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:16.305339 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:16.399239 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:16.399201 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:16.499609 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:16.499574 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:17.877909 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:17.877872 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:20.193781 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:20.193747 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:44:23.619928 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:23.619838 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:23.731218 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:23.731159 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:23.860162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:23.860126 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:23.992788 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:23.992756 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:24.341568 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:24.341461 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:50.311371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:50.311292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:55.993443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:55.993397 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:56.091319 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:56.091285 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:44:56.191610 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:44:56.191581 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:01.941111 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:01.940992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:45:01.947233 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:01.944477 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:45:01.947233 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:01.946575 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:45:01.949661 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:01.949623 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:45:12.069171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:12.069137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:17.879596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:17.879561 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:18.015393 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:18.015323 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:18.149008 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:18.148902 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:28.636763 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:28.636724 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:29.434811 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:29.434767 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:35.140082 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:35.140046 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:35.250402 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:35.250314 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:35.341032 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:35.340976 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:35.448217 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:35.448104 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:36.228141 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:36.228010 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:36.309347 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:36.309306 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:36.409842 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:36.409790 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:38.026702 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:38.026673 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:38.302792 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:38.302711 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:45:44.212182 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:44.212135 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:44.326981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:44.326943 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:44.903913 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:44.903876 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:47.199476 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:47.199440 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:45:50.775023 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:50.774994 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:50.842025 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:50.841989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:51.005509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:51.005446 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:51.399357 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:51.399324 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:51.818488 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:51.818427 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:54.408865 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:54.408824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:54.494009 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:54.493973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:54.553050 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:54.553016 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:54.836735 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:54.836701 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:54.971795 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:54.971765 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:55.071926 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:55.071889 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:58.902968 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:58.902936 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:59.090465 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:59.090421 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:45:59.569295 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:59.569252 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:59.668557 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:59.668519 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:45:59.995274 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:45:59.995240 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:05.705447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:05.705409 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:05.768931 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:05.768867 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:06.109213 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:06.109180 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:06.470207 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:06.470156 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:06.526170 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:06.526097 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:09.500424 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:09.500395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:46:12.177546 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:12.177505 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:12.280373 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:12.280338 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:12.443888 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:12.443791 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:12.703022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:12.702913 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:12.803786 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:12.803733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:12.905272 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:12.905225 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:13.005398 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:13.005363 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:18.737199 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:18.737119 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:18.798854 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:18.798813 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:18.872208 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:18.872176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:18.973272 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:18.973236 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:19.086934 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:19.086847 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:24.831197 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:24.831159 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:24.933962 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:24.933925 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:31.549917 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:31.549877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:31.855999 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:31.855913 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:32.206018 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:32.205928 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:34.705231 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:34.705191 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:34.782214 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:34.782173 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:34.851059 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:34.851025 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:35.093136 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:35.093096 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:35.321464 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:35.321429 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:35.423145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:35.423056 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:39.119502 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:39.119466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:39.995814 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:39.995775 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:46:48.337511 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:48.337474 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:54.397200 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:54.397164 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:46:57.352360 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:57.352318 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:46:57.405576 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:46:57.405541 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:02.688335 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:02.688296 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:47:03.285144 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:03.285101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:03.388207 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:03.388167 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:06.315128 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:06.315090 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:06.969019 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:06.968986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:07.068557 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:07.068515 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:07.222171 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:07.222097 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:12.402734 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:12.402686 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:17.426476 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:17.426439 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:17.887813 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:17.887776 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:47:53.951538 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:53.951452 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:55.090766 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:55.090731 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:47:57.394477 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:47:57.394430 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:48:00.010778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:00.010740 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:05.484792 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:05.484746 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:05.591421 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:05.591378 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:05.761600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:05.761520 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:06.026029 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:06.025936 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:07.059881 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:07.059849 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:07.151160 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:07.151122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:07.258924 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:07.258885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:07.942798 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:07.942755 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:08.041996 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:08.041968 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:08.146040 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:08.146000 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:09.301104 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:09.301071 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:48:09.481564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:09.481528 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:15.155122 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:15.155087 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:15.206325 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:15.206292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:15.822535 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:15.822502 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:21.509874 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:21.509830 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:21.619846 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:21.619809 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:21.715557 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:21.715528 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:23.105505 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:23.105468 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:48:32.225579 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:32.225548 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:32.566603 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:32.566522 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:53.544509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:53.544472 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:59.159136 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:59.159099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:59.222778 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:59.222742 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:59.507531 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:59.507502 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:48:59.814697 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:48:59.814592 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:00.328176 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:00.328139 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:02.407195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:02.407157 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:02.498319 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:02.498285 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:02.631860 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:02.631819 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:02.977535 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:02.977497 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:03.082806 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:03.082768 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:03.183048 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:03.183009 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:06.903236 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:06.903200 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:07.244834 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:07.244800 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:07.554271 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:07.554187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:07.877943 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:07.877863 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:09.504008 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:09.503978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:49:10.831774 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:10.831732 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:10.936562 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:10.936527 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:11.076095 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:11.076064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:11.578036 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:11.578002 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:11.676974 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:11.676935 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:11.776981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:11.776948 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:15.334545 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:15.334509 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:22.297364 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:22.297330 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:49:23.779368 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:23.779332 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:23.880890 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:23.880855 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:28.517243 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:28.517209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:28.617822 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:28.617792 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:29.903571 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:29.903521 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:33.378134 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:33.378066 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:33.478810 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:33.478783 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:33.989395 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:33.989360 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:49:52.027919 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:52.027883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:49:56.111756 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:49:56.111715 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:50:01.975414 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:01.975386 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:50:01.978738 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:01.978712 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:50:01.980991 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:01.980970 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:50:01.984495 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:01.984477 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:50:18.966840 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:18.966802 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:20.057145 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:20.057110 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:20.321135 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:20.321050 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:20.835215 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:20.835185 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:21.037865 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:21.037824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:21.136244 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:21.136166 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:21.304236 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:21.304199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:23.697703 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:23.697666 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:50:25.812511 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:25.812481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:50:50.851139 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:50:50.851061 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:02.900769 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:02.900733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:03.190808 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:03.190718 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:03.420258 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:03.420224 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:03.595647 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:03.595612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:04.066101 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:04.066064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:04.180526 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:04.180490 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:04.283156 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:04.283118 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:04.483443 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:04.483406 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:07.312041 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:07.312000 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:51:10.306015 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:10.305971 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:10.407405 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:10.407377 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:10.609665 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:10.609552 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:10.963489 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:10.963459 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:11.227957 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:11.227866 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:11.615181 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:11.615093 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:12.191241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:12.191212 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:14.200577 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:14.200548 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:14.380400 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:14.380369 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:14.584349 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:14.584314 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:15.002205 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:15.002161 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:15.415299 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:15.415206 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:15.532793 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:15.532754 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:18.695182 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:18.695146 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:19.197053 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:19.197010 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:19.554529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:19.554470 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:19.639757 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:19.639721 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:21.904378 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:21.904345 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:51:22.563099 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:22.563038 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:22.695687 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:22.695620 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:22.796195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:22.796137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:23.008354 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:23.008321 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:23.389569 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:23.389485 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:23.491022 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:23.490992 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:27.073256 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:27.073209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:35.300543 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:35.300496 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:35.670591 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:35.670503 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:35.797682 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:35.797628 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:35.902834 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:35.902795 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:36.144066 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:36.144030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:37.520544 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:37.520504 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:51:42.137216 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:42.137178 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:42.267556 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:42.267514 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:42.542109 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:42.542075 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:42.704818 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:42.704777 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:42.918419 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:42.918387 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:43.327092 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:43.327058 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:43.583949 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:43.583837 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:43.724961 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:43.724923 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:43.997412 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:43.997364 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:47.100308 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:47.100270 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:51:49.653148 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:49.653111 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:49.751854 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:49.751819 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:49.928728 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:49.928625 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:50.197088 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:50.197010 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:50.573090 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:50.573059 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:51.031989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:51.031954 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:51.291016 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:51.290910 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:54.494240 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:54.494187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:54.656762 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:54.656733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:54.801727 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:54.801614 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:55.298148 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:55.298116 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:55.885278 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:55.885245 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:56.030140 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:56.030091 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:58.426805 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:58.426764 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:51:58.944483 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:58.944445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:59.285416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:59.285386 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:51:59.666867 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:51:59.666741 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:00.084198 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:00.084136 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:02.799130 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:02.799090 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:02.951593 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:02.951555 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:03.196699 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:03.196583 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:03.362080 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:03.362049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:03.678769 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:03.678725 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:03.780005 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:03.779973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:04.653786 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:04.653742 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:04.754842 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:04.754807 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:05.863607 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:05.863563 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:06.083162 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:06.083128 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:07.423582 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:07.423536 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:14.601114 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:14.601079 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:52:16.833665 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:16.833595 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:16.930077 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:16.930041 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:24.720927 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:24.720892 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:24.860103 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:24.860068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:47.261474 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:47.261435 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:52:50.312688 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:52:50.312654 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:53:21.647988 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.647954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp"] Jul 07 02:53:21.648485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.648297 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" containerName="authorino" Jul 07 02:53:21.648485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.648307 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" containerName="authorino" Jul 07 02:53:21.648485 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.648387 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8ff76e-a4c3-47a1-a673-7bf58b0e0aab" containerName="authorino" Jul 07 02:53:21.651442 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.651425 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.653720 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.653696 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"default-dockercfg-cjxqc\"" Jul 07 02:53:21.654322 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.654291 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"auth-test-model-890bdd-kserve-self-signed-certs\"" Jul 07 02:53:21.654447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.654349 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"kube-root-ca.crt\"" Jul 07 02:53:21.654447 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.654436 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"openshift-service-ca.crt\"" Jul 07 02:53:21.661655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.661608 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp"] Jul 07 02:53:21.681795 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.681761 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:53:21.705934 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.705886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-home\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.705934 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.705936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-tmp-dir\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.706195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.706036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-model-cache\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.706195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.706063 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74wjx\" (UniqueName: \"kubernetes.io/projected/86b06d48-5aec-4828-af58-fbed47736aed-kube-api-access-74wjx\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.706195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.706142 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-dshm\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.706195 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.706192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86b06d48-5aec-4828-af58-fbed47736aed-tls-certs\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-dshm\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807413 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86b06d48-5aec-4828-af58-fbed47736aed-tls-certs\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807708 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-home\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807708 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-tmp-dir\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807708 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-model-cache\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807708 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74wjx\" (UniqueName: \"kubernetes.io/projected/86b06d48-5aec-4828-af58-fbed47736aed-kube-api-access-74wjx\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807943 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807909 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-home\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.807943 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807930 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-tmp-dir\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.808061 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.807994 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-model-cache\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.809981 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.809959 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-dshm\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.810267 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.810251 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86b06d48-5aec-4828-af58-fbed47736aed-tls-certs\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.815831 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.815807 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74wjx\" (UniqueName: \"kubernetes.io/projected/86b06d48-5aec-4828-af58-fbed47736aed-kube-api-access-74wjx\") pod \"auth-test-model-890bdd-kserve-6b647ddb7-wn8vp\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:21.961991 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:21.961954 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:22.105823 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:22.105790 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp"] Jul 07 02:53:22.107782 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:53:22.107750 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86b06d48_5aec_4828_af58_fbed47736aed.slice/crio-d8ae0d651ca459b77f1317f0304c2e7b9909a48a4817289ab36748f29c909d69 WatchSource:0}: Error finding container d8ae0d651ca459b77f1317f0304c2e7b9909a48a4817289ab36748f29c909d69: Status 404 returned error can't find the container with id d8ae0d651ca459b77f1317f0304c2e7b9909a48a4817289ab36748f29c909d69 Jul 07 02:53:22.109916 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:22.109895 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:53:22.554753 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:22.554688 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" event={"ID":"86b06d48-5aec-4828-af58-fbed47736aed","Type":"ContainerStarted","Data":"d8ae0d651ca459b77f1317f0304c2e7b9909a48a4817289ab36748f29c909d69"} Jul 07 02:53:23.561612 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:23.561520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" event={"ID":"86b06d48-5aec-4828-af58-fbed47736aed","Type":"ContainerStarted","Data":"4f72d79748defd3f6783ef80732236444c6db2f97fa50bc8d51fcadcec913113"} Jul 07 02:53:23.579944 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:23.579882 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" podStartSLOduration=1.435698179 podStartE2EDuration="2.57986506s" totalImagesPullingTime="1.144166881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:53:23.57866873 +0000 UTC m=+2305.073693252" watchObservedRunningTime="2026-07-07 02:53:23.57986506 +0000 UTC m=+2305.074889591" Jul 07 02:53:25.290393 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:25.290357 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:53:31.962663 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:31.962597 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:31.963070 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:31.962674 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:31.975772 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:31.975745 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:32.622740 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:32.622703 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:53:38.177174 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:38.177135 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:53:51.997410 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:53:51.997328 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:54:04.342989 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:04.342946 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:54:04.407535 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:04.407501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:54:06.500675 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:06.500622 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:54:22.196738 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:22.196700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:54:38.314874 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:38.314840 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:54:39.460160 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:39.460127 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:54:55.702663 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:54:55.702615 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:55:02.010099 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:02.009985 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:55:02.014368 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:02.013189 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:55:02.017655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:02.017586 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:55:02.020622 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:02.020604 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 02:55:12.491087 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:12.491051 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:55:28.794843 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:28.794808 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:55:32.273675 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:32.273620 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:55:33.149865 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:33.149834 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp"] Jul 07 02:55:33.174064 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:33.174030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:55:43.196689 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:43.196648 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:55:48.170131 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.170089 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" podUID="86b06d48-5aec-4828-af58-fbed47736aed" containerName="main" containerID="cri-o://4f72d79748defd3f6783ef80732236444c6db2f97fa50bc8d51fcadcec913113" gracePeriod=45 Jul 07 02:55:48.343674 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.343549 2556 generic.go:356] "Generic (PLEG): container finished" podID="86b06d48-5aec-4828-af58-fbed47736aed" containerID="4f72d79748defd3f6783ef80732236444c6db2f97fa50bc8d51fcadcec913113" exitCode=0 Jul 07 02:55:48.343674 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.343653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" event={"ID":"86b06d48-5aec-4828-af58-fbed47736aed","Type":"ContainerDied","Data":"4f72d79748defd3f6783ef80732236444c6db2f97fa50bc8d51fcadcec913113"} Jul 07 02:55:48.422050 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.421992 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:55:48.524975 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.524938 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-dshm\") pod \"86b06d48-5aec-4828-af58-fbed47736aed\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " Jul 07 02:55:48.524975 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.524975 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86b06d48-5aec-4828-af58-fbed47736aed-tls-certs\") pod \"86b06d48-5aec-4828-af58-fbed47736aed\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " Jul 07 02:55:48.525189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525011 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-home\") pod \"86b06d48-5aec-4828-af58-fbed47736aed\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " Jul 07 02:55:48.525189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525049 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74wjx\" (UniqueName: \"kubernetes.io/projected/86b06d48-5aec-4828-af58-fbed47736aed-kube-api-access-74wjx\") pod \"86b06d48-5aec-4828-af58-fbed47736aed\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " Jul 07 02:55:48.525189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525088 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-model-cache\") pod \"86b06d48-5aec-4828-af58-fbed47736aed\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " Jul 07 02:55:48.525189 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525111 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-tmp-dir\") pod \"86b06d48-5aec-4828-af58-fbed47736aed\" (UID: \"86b06d48-5aec-4828-af58-fbed47736aed\") " Jul 07 02:55:48.525402 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525305 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-home" (OuterVolumeSpecName: "home") pod "86b06d48-5aec-4828-af58-fbed47736aed" (UID: "86b06d48-5aec-4828-af58-fbed47736aed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:55:48.525402 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525365 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-model-cache" (OuterVolumeSpecName: "model-cache") pod "86b06d48-5aec-4828-af58-fbed47736aed" (UID: "86b06d48-5aec-4828-af58-fbed47736aed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:55:48.525498 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525425 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86b06d48-5aec-4828-af58-fbed47736aed" (UID: "86b06d48-5aec-4828-af58-fbed47736aed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:55:48.525533 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.525504 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:55:48.527416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.527397 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-dshm" (OuterVolumeSpecName: "dshm") pod "86b06d48-5aec-4828-af58-fbed47736aed" (UID: "86b06d48-5aec-4828-af58-fbed47736aed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:55:48.527738 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.527714 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b06d48-5aec-4828-af58-fbed47736aed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86b06d48-5aec-4828-af58-fbed47736aed" (UID: "86b06d48-5aec-4828-af58-fbed47736aed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:55:48.527833 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.527735 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b06d48-5aec-4828-af58-fbed47736aed-kube-api-access-74wjx" (OuterVolumeSpecName: "kube-api-access-74wjx") pod "86b06d48-5aec-4828-af58-fbed47736aed" (UID: "86b06d48-5aec-4828-af58-fbed47736aed"). InnerVolumeSpecName "kube-api-access-74wjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:55:48.626655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.626599 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:55:48.626655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.626630 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:55:48.626655 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.626665 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86b06d48-5aec-4828-af58-fbed47736aed-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:55:48.626881 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.626673 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86b06d48-5aec-4828-af58-fbed47736aed-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:55:48.626881 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:48.626681 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74wjx\" (UniqueName: \"kubernetes.io/projected/86b06d48-5aec-4828-af58-fbed47736aed-kube-api-access-74wjx\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:55:49.351332 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:49.351244 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" event={"ID":"86b06d48-5aec-4828-af58-fbed47736aed","Type":"ContainerDied","Data":"d8ae0d651ca459b77f1317f0304c2e7b9909a48a4817289ab36748f29c909d69"} Jul 07 02:55:49.351332 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:49.351266 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp" Jul 07 02:55:49.351332 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:49.351303 2556 scope.go:117] "RemoveContainer" containerID="4f72d79748defd3f6783ef80732236444c6db2f97fa50bc8d51fcadcec913113" Jul 07 02:55:49.372759 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:49.372727 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp"] Jul 07 02:55:49.374965 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:49.374944 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/auth-test-model-890bdd-kserve-6b647ddb7-wn8vp"] Jul 07 02:55:50.187205 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:50.187146 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:55:51.042698 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:51.042627 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b06d48-5aec-4828-af58-fbed47736aed" path="/var/lib/kubelet/pods/86b06d48-5aec-4828-af58-fbed47736aed/volumes" Jul 07 02:55:53.501444 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:55:53.501407 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:56:07.809596 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:07.809547 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:56:07.911502 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:07.911472 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:56:16.642350 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.642312 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx"] Jul 07 02:56:16.642819 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.642705 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b06d48-5aec-4828-af58-fbed47736aed" containerName="main" Jul 07 02:56:16.642819 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.642728 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b06d48-5aec-4828-af58-fbed47736aed" containerName="main" Jul 07 02:56:16.642819 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.642791 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b06d48-5aec-4828-af58-fbed47736aed" containerName="main" Jul 07 02:56:16.645936 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.645907 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.648690 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.648667 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"openshift-service-ca.crt\"" Jul 07 02:56:16.648834 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.648666 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"default-dockercfg-cjxqc\"" Jul 07 02:56:16.648834 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.648665 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"sub-test-model-890bdd-kserve-self-signed-certs\"" Jul 07 02:56:16.648834 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.648779 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"kube-root-ca.crt\"" Jul 07 02:56:16.655909 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.655883 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx"] Jul 07 02:56:16.680137 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.680104 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:56:16.779023 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.778985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-home\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.779023 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.779021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-model-cache\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.779288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.779045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-tmp-dir\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.779288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.779107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-dshm\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.779288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.779132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jswqz\" (UniqueName: \"kubernetes.io/projected/c4eba0f6-925d-4983-86b0-68d63c929243-kube-api-access-jswqz\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.779288 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.779191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba0f6-925d-4983-86b0-68d63c929243-tls-certs\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.880564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-home\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.880564 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-model-cache\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.880868 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-tmp-dir\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.880868 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-dshm\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.880868 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jswqz\" (UniqueName: \"kubernetes.io/projected/c4eba0f6-925d-4983-86b0-68d63c929243-kube-api-access-jswqz\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.880868 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba0f6-925d-4983-86b0-68d63c929243-tls-certs\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.881098 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.880956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-home\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.881098 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.881047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-tmp-dir\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.881202 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.881092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-model-cache\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.883157 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.883137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-dshm\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.883511 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.883487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba0f6-925d-4983-86b0-68d63c929243-tls-certs\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.889933 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.889907 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jswqz\" (UniqueName: \"kubernetes.io/projected/c4eba0f6-925d-4983-86b0-68d63c929243-kube-api-access-jswqz\") pod \"sub-test-model-890bdd-kserve-7998645f6f-mxppx\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:16.957068 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:16.956956 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:17.101571 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:17.101544 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx"] Jul 07 02:56:17.104344 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:56:17.104319 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4eba0f6_925d_4983_86b0_68d63c929243.slice/crio-f1d20ca909f791e0427478463a12f820230806058b6b073cc09fb0630a1cfc05 WatchSource:0}: Error finding container f1d20ca909f791e0427478463a12f820230806058b6b073cc09fb0630a1cfc05: Status 404 returned error can't find the container with id f1d20ca909f791e0427478463a12f820230806058b6b073cc09fb0630a1cfc05 Jul 07 02:56:17.502712 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:17.502677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" event={"ID":"c4eba0f6-925d-4983-86b0-68d63c929243","Type":"ContainerStarted","Data":"934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea"} Jul 07 02:56:17.502906 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:17.502723 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" event={"ID":"c4eba0f6-925d-4983-86b0-68d63c929243","Type":"ContainerStarted","Data":"f1d20ca909f791e0427478463a12f820230806058b6b073cc09fb0630a1cfc05"} Jul 07 02:56:17.527598 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:17.527529 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" podStartSLOduration=1.5275128759999999 podStartE2EDuration="1.527512876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:56:17.524984528 +0000 UTC m=+2479.020009059" watchObservedRunningTime="2026-07-07 02:56:17.527512876 +0000 UTC m=+2479.022537440" Jul 07 02:56:20.902939 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:20.902893 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:56:26.957795 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:26.957747 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:26.957795 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:26.957809 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:26.970541 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:26.970514 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:27.571209 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:27.571178 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:56:29.779824 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:29.779789 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:56:36.393872 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:36.393836 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:56:53.945838 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:53.945720 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:56:54.752954 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:54.752914 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx"] Jul 07 02:56:54.775653 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:54.775583 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:56:58.799417 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:56:58.799377 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:57:05.432428 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:05.432378 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:05.530085 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:05.530050 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:05.777497 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:05.777470 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:09.774427 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:09.774374 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" podUID="c4eba0f6-925d-4983-86b0-68d63c929243" containerName="main" containerID="cri-o://934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea" gracePeriod=45 Jul 07 02:57:10.029864 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.029802 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:57:10.164725 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.164688 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba0f6-925d-4983-86b0-68d63c929243-tls-certs\") pod \"c4eba0f6-925d-4983-86b0-68d63c929243\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " Jul 07 02:57:10.164932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.164737 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-model-cache\") pod \"c4eba0f6-925d-4983-86b0-68d63c929243\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " Jul 07 02:57:10.164932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.164756 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-tmp-dir\") pod \"c4eba0f6-925d-4983-86b0-68d63c929243\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " Jul 07 02:57:10.164932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.164783 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-home\") pod \"c4eba0f6-925d-4983-86b0-68d63c929243\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " Jul 07 02:57:10.164932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.164897 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-dshm\") pod \"c4eba0f6-925d-4983-86b0-68d63c929243\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " Jul 07 02:57:10.165148 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.164938 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jswqz\" (UniqueName: \"kubernetes.io/projected/c4eba0f6-925d-4983-86b0-68d63c929243-kube-api-access-jswqz\") pod \"c4eba0f6-925d-4983-86b0-68d63c929243\" (UID: \"c4eba0f6-925d-4983-86b0-68d63c929243\") " Jul 07 02:57:10.165148 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.165004 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4eba0f6-925d-4983-86b0-68d63c929243" (UID: "c4eba0f6-925d-4983-86b0-68d63c929243"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:57:10.165148 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.165040 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4eba0f6-925d-4983-86b0-68d63c929243" (UID: "c4eba0f6-925d-4983-86b0-68d63c929243"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:57:10.165148 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.165054 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-home" (OuterVolumeSpecName: "home") pod "c4eba0f6-925d-4983-86b0-68d63c929243" (UID: "c4eba0f6-925d-4983-86b0-68d63c929243"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:57:10.165301 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.165208 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:57:10.165301 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.165225 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:57:10.165301 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.165236 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:57:10.167153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.167131 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eba0f6-925d-4983-86b0-68d63c929243-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4eba0f6-925d-4983-86b0-68d63c929243" (UID: "c4eba0f6-925d-4983-86b0-68d63c929243"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:57:10.167153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.167134 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-dshm" (OuterVolumeSpecName: "dshm") pod "c4eba0f6-925d-4983-86b0-68d63c929243" (UID: "c4eba0f6-925d-4983-86b0-68d63c929243"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:57:10.167325 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.167304 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4eba0f6-925d-4983-86b0-68d63c929243-kube-api-access-jswqz" (OuterVolumeSpecName: "kube-api-access-jswqz") pod "c4eba0f6-925d-4983-86b0-68d63c929243" (UID: "c4eba0f6-925d-4983-86b0-68d63c929243"). InnerVolumeSpecName "kube-api-access-jswqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:57:10.266020 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.265983 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4eba0f6-925d-4983-86b0-68d63c929243-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:57:10.266020 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.266013 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jswqz\" (UniqueName: \"kubernetes.io/projected/c4eba0f6-925d-4983-86b0-68d63c929243-kube-api-access-jswqz\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:57:10.266229 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.266031 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4eba0f6-925d-4983-86b0-68d63c929243-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:57:10.595600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.595565 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:57:10.807859 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.807819 2556 generic.go:356] "Generic (PLEG): container finished" podID="c4eba0f6-925d-4983-86b0-68d63c929243" containerID="934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea" exitCode=0 Jul 07 02:57:10.808273 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.807876 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" Jul 07 02:57:10.808273 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.807883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" event={"ID":"c4eba0f6-925d-4983-86b0-68d63c929243","Type":"ContainerDied","Data":"934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea"} Jul 07 02:57:10.808273 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.807922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx" event={"ID":"c4eba0f6-925d-4983-86b0-68d63c929243","Type":"ContainerDied","Data":"f1d20ca909f791e0427478463a12f820230806058b6b073cc09fb0630a1cfc05"} Jul 07 02:57:10.808273 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.807942 2556 scope.go:117] "RemoveContainer" containerID="934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea" Jul 07 02:57:10.817791 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.817769 2556 scope.go:117] "RemoveContainer" containerID="934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea" Jul 07 02:57:10.818069 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:57:10.818051 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea\": container with ID starting with 934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea not found: ID does not exist" containerID="934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea" Jul 07 02:57:10.818120 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.818076 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea"} err="failed to get container status \"934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea\": rpc error: code = NotFound desc = could not find container \"934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea\": container with ID starting with 934b8a76862305b5527ad8057b577c640f9d1d97cefde474d6b06b1b600749ea not found: ID does not exist" Jul 07 02:57:10.828563 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.828538 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx"] Jul 07 02:57:10.832543 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:10.832524 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/sub-test-model-890bdd-kserve-7998645f6f-mxppx"] Jul 07 02:57:11.043369 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:11.043333 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4eba0f6-925d-4983-86b0-68d63c929243" path="/var/lib/kubelet/pods/c4eba0f6-925d-4983-86b0-68d63c929243/volumes" Jul 07 02:57:17.716937 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:17.716905 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:17.817538 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:17.817501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:25.650153 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:25.650116 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:25.749254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:25.749220 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:42.535064 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.534972 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6"] Jul 07 02:57:42.535455 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.535444 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4eba0f6-925d-4983-86b0-68d63c929243" containerName="main" Jul 07 02:57:42.535496 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.535462 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4eba0f6-925d-4983-86b0-68d63c929243" containerName="main" Jul 07 02:57:42.535571 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.535558 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4eba0f6-925d-4983-86b0-68d63c929243" containerName="main" Jul 07 02:57:42.538732 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.538711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.541107 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.541090 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"openshift-service-ca.crt\"" Jul 07 02:57:42.541219 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.541171 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"kube-root-ca.crt\"" Jul 07 02:57:42.541782 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.541764 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"default-dockercfg-cjxqc\"" Jul 07 02:57:42.541913 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.541787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-890bdd\"/\"rate-test-model-890bdd-kserve-self-signed-certs\"" Jul 07 02:57:42.549708 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.549683 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6"] Jul 07 02:57:42.564861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.564834 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:42.654231 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.654195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-dshm\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.654231 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.654233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-model-cache\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.654486 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.654256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-home\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.654486 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.654286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj76n\" (UniqueName: \"kubernetes.io/projected/30bf0677-e2ad-4b0b-a05c-77661734461b-kube-api-access-lj76n\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.654486 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.654308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bf0677-e2ad-4b0b-a05c-77661734461b-tls-certs\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.654486 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.654335 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-tmp-dir\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj76n\" (UniqueName: \"kubernetes.io/projected/30bf0677-e2ad-4b0b-a05c-77661734461b-kube-api-access-lj76n\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755058 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bf0677-e2ad-4b0b-a05c-77661734461b-tls-certs\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755312 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-tmp-dir\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755312 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755150 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-dshm\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755312 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755170 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-model-cache\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755312 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-home\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755610 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755580 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-tmp-dir\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755744 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-home\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.755744 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.755628 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-model-cache\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.757670 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.757629 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-dshm\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.757931 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.757911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bf0677-e2ad-4b0b-a05c-77661734461b-tls-certs\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.764140 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.764118 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj76n\" (UniqueName: \"kubernetes.io/projected/30bf0677-e2ad-4b0b-a05c-77661734461b-kube-api-access-lj76n\") pod \"rate-test-model-890bdd-kserve-9bf64d459-k6wb6\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.848932 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.848847 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:42.989705 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:42.989680 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6"] Jul 07 02:57:42.991655 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:57:42.991614 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30bf0677_e2ad_4b0b_a05c_77661734461b.slice/crio-79b4f1293d30080ff6cc0b0e6b84a9dca5f9be7feaf0120c6e1586c424f91194 WatchSource:0}: Error finding container 79b4f1293d30080ff6cc0b0e6b84a9dca5f9be7feaf0120c6e1586c424f91194: Status 404 returned error can't find the container with id 79b4f1293d30080ff6cc0b0e6b84a9dca5f9be7feaf0120c6e1586c424f91194 Jul 07 02:57:43.983286 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:43.983248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" event={"ID":"30bf0677-e2ad-4b0b-a05c-77661734461b","Type":"ContainerStarted","Data":"4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f"} Jul 07 02:57:43.983286 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:43.983287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" event={"ID":"30bf0677-e2ad-4b0b-a05c-77661734461b","Type":"ContainerStarted","Data":"79b4f1293d30080ff6cc0b0e6b84a9dca5f9be7feaf0120c6e1586c424f91194"} Jul 07 02:57:44.002814 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:44.002741 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" podStartSLOduration=2.002723711 podStartE2EDuration="2.002723711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:57:44.000953461 +0000 UTC m=+2565.495978005" watchObservedRunningTime="2026-07-07 02:57:44.002723711 +0000 UTC m=+2565.497748241" Jul 07 02:57:46.403519 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:46.403477 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:57:47.799762 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:47.799726 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:57:52.849038 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:52.849003 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:52.849429 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:52.849055 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:52.861613 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:52.861590 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:57:53.049666 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:57:53.049619 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:58:05.499166 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:05.499130 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:58:19.395525 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:19.395445 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:58:26.121912 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:26.121874 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:26.946063 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:26.946023 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6"] Jul 07 02:58:27.469882 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:27.469849 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:28.023944 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:28.023907 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:28.446255 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:28.446171 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:28.605079 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:28.605046 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:28.705923 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:28.705804 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:28.852371 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:28.852337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:32.295182 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:32.295148 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:58:33.503396 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:33.503361 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:58:41.967731 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:41.967687 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" podUID="30bf0677-e2ad-4b0b-a05c-77661734461b" containerName="main" containerID="cri-o://4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f" gracePeriod=45 Jul 07 02:58:42.219901 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.219836 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:58:42.297801 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.297768 2556 generic.go:356] "Generic (PLEG): container finished" podID="30bf0677-e2ad-4b0b-a05c-77661734461b" containerID="4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f" exitCode=0 Jul 07 02:58:42.297980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.297810 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" Jul 07 02:58:42.297980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.297852 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" event={"ID":"30bf0677-e2ad-4b0b-a05c-77661734461b","Type":"ContainerDied","Data":"4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f"} Jul 07 02:58:42.297980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.297893 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6" event={"ID":"30bf0677-e2ad-4b0b-a05c-77661734461b","Type":"ContainerDied","Data":"79b4f1293d30080ff6cc0b0e6b84a9dca5f9be7feaf0120c6e1586c424f91194"} Jul 07 02:58:42.297980 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.297911 2556 scope.go:117] "RemoveContainer" containerID="4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f" Jul 07 02:58:42.306855 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.306837 2556 scope.go:117] "RemoveContainer" containerID="4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f" Jul 07 02:58:42.307154 ip-10-0-133-186 kubenswrapper[2556]: E0707 02:58:42.307132 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f\": container with ID starting with 4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f not found: ID does not exist" containerID="4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f" Jul 07 02:58:42.307207 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.307164 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f"} err="failed to get container status \"4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f\": rpc error: code = NotFound desc = could not find container \"4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f\": container with ID starting with 4ba90cb8a005773347f8264737a49b62ebc8af0cacb83fca325ae095a553c77f not found: ID does not exist" Jul 07 02:58:42.377225 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377183 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj76n\" (UniqueName: \"kubernetes.io/projected/30bf0677-e2ad-4b0b-a05c-77661734461b-kube-api-access-lj76n\") pod \"30bf0677-e2ad-4b0b-a05c-77661734461b\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " Jul 07 02:58:42.377399 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377263 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-tmp-dir\") pod \"30bf0677-e2ad-4b0b-a05c-77661734461b\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " Jul 07 02:58:42.377399 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377363 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-home\") pod \"30bf0677-e2ad-4b0b-a05c-77661734461b\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " Jul 07 02:58:42.377517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377406 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-model-cache\") pod \"30bf0677-e2ad-4b0b-a05c-77661734461b\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " Jul 07 02:58:42.377517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377442 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bf0677-e2ad-4b0b-a05c-77661734461b-tls-certs\") pod \"30bf0677-e2ad-4b0b-a05c-77661734461b\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " Jul 07 02:58:42.377517 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377476 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-dshm\") pod \"30bf0677-e2ad-4b0b-a05c-77661734461b\" (UID: \"30bf0677-e2ad-4b0b-a05c-77661734461b\") " Jul 07 02:58:42.377698 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377518 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30bf0677-e2ad-4b0b-a05c-77661734461b" (UID: "30bf0677-e2ad-4b0b-a05c-77661734461b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:58:42.377757 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377693 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-home" (OuterVolumeSpecName: "home") pod "30bf0677-e2ad-4b0b-a05c-77661734461b" (UID: "30bf0677-e2ad-4b0b-a05c-77661734461b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:58:42.377757 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377748 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-tmp-dir\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:58:42.377832 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.377774 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-model-cache" (OuterVolumeSpecName: "model-cache") pod "30bf0677-e2ad-4b0b-a05c-77661734461b" (UID: "30bf0677-e2ad-4b0b-a05c-77661734461b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:58:42.379704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.379669 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bf0677-e2ad-4b0b-a05c-77661734461b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30bf0677-e2ad-4b0b-a05c-77661734461b" (UID: "30bf0677-e2ad-4b0b-a05c-77661734461b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:58:42.379704 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.379688 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-dshm" (OuterVolumeSpecName: "dshm") pod "30bf0677-e2ad-4b0b-a05c-77661734461b" (UID: "30bf0677-e2ad-4b0b-a05c-77661734461b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:58:42.379855 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.379703 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bf0677-e2ad-4b0b-a05c-77661734461b-kube-api-access-lj76n" (OuterVolumeSpecName: "kube-api-access-lj76n") pod "30bf0677-e2ad-4b0b-a05c-77661734461b" (UID: "30bf0677-e2ad-4b0b-a05c-77661734461b"). InnerVolumeSpecName "kube-api-access-lj76n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:58:42.479102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.479014 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj76n\" (UniqueName: \"kubernetes.io/projected/30bf0677-e2ad-4b0b-a05c-77661734461b-kube-api-access-lj76n\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:58:42.479102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.479047 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-home\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:58:42.479102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.479059 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-model-cache\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:58:42.479102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.479068 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bf0677-e2ad-4b0b-a05c-77661734461b-tls-certs\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:58:42.479102 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.479075 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30bf0677-e2ad-4b0b-a05c-77661734461b-dshm\") on node \"ip-10-0-133-186.ec2.internal\" DevicePath \"\"" Jul 07 02:58:42.619006 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.618977 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6"] Jul 07 02:58:42.624710 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:42.624684 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-890bdd/rate-test-model-890bdd-kserve-9bf64d459-k6wb6"] Jul 07 02:58:43.041741 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:58:43.041709 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30bf0677-e2ad-4b0b-a05c-77661734461b" path="/var/lib/kubelet/pods/30bf0677-e2ad-4b0b-a05c-77661734461b/volumes" Jul 07 02:59:10.439225 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:10.439188 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:10.706816 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:10.706727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:10.941949 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:10.941918 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:11.135513 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:11.135476 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:11.535808 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:11.535772 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:11.635547 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:11.635511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:11.735693 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:11.735660 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:11.888571 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:11.888483 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:14.691338 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:14.691291 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rpptr"] Jul 07 02:59:17.360958 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:17.360924 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:17.461396 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:17.461364 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:17.631509 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:17.631389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:17.854883 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:17.854849 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:18.256029 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:18.255994 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55c57b679f-gqtrf_8a7acb9e-26a6-48a4-9d19-ff7860578dc7/authorino/0.log" Jul 07 02:59:23.493104 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:23.493076 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvgjj_c36ac8b2-b206-4be3-b8af-09e1017b7e25/server/0.log" Jul 07 02:59:23.608812 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:23.608784 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fmfm6_fe03661b-9f5f-4b82-ae91-f91895259b43/manager/0.log" Jul 07 02:59:23.958744 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:23.958666 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r47kn_115e3778-6036-4ae1-b670-fcc9bc195805/copy-manifests/0.log" Jul 07 02:59:23.971333 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:23.971307 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r47kn_115e3778-6036-4ae1-b670-fcc9bc195805/manager/0.log" Jul 07 02:59:24.856260 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:24.856225 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b_31ab40ac-9c2a-4d9b-ae31-3b2403a7db66/util/0.log" Jul 07 02:59:24.862406 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:24.862385 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b_31ab40ac-9c2a-4d9b-ae31-3b2403a7db66/pull/0.log" Jul 07 02:59:24.868776 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:24.868750 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b_31ab40ac-9c2a-4d9b-ae31-3b2403a7db66/extract/0.log" Jul 07 02:59:24.989210 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:24.989175 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2_21a883a1-9981-4989-b191-75860e37a02a/util/0.log" Jul 07 02:59:24.995964 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:24.995945 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2_21a883a1-9981-4989-b191-75860e37a02a/pull/0.log" Jul 07 02:59:25.003717 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.003694 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2_21a883a1-9981-4989-b191-75860e37a02a/extract/0.log" Jul 07 02:59:25.133943 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.133861 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp_eab19e08-aa68-487f-89ca-829b668c1967/util/0.log" Jul 07 02:59:25.140911 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.140887 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp_eab19e08-aa68-487f-89ca-829b668c1967/pull/0.log" Jul 07 02:59:25.148430 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.148411 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp_eab19e08-aa68-487f-89ca-829b668c1967/extract/0.log" Jul 07 02:59:25.259416 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.259385 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v_b79ee471-c4fb-48ad-a09b-91760a1f51b8/util/0.log" Jul 07 02:59:25.265835 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.265804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v_b79ee471-c4fb-48ad-a09b-91760a1f51b8/pull/0.log" Jul 07 02:59:25.272087 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.272067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v_b79ee471-c4fb-48ad-a09b-91760a1f51b8/extract/0.log" Jul 07 02:59:25.392602 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.392513 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55c57b679f-gqtrf_8a7acb9e-26a6-48a4-9d19-ff7860578dc7/authorino/0.log" Jul 07 02:59:25.739126 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:25.739099 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w7fzq_b3c677e5-b562-40bc-a7b5-b15faa693e1d/kuadrant-console-plugin/0.log" Jul 07 02:59:26.088808 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:26.088731 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rpptr_9e272336-2774-40a3-8124-359e17815c26/limitador/0.log" Jul 07 02:59:26.777599 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:26.777565 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-8kvmk_d0284b30-881e-45e1-82ba-6425509ab352/kube-auth-proxy/0.log" Jul 07 02:59:32.886715 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.886676 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtppw/must-gather-rqvbw"] Jul 07 02:59:32.887187 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.887022 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bf0677-e2ad-4b0b-a05c-77661734461b" containerName="main" Jul 07 02:59:32.887187 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.887034 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bf0677-e2ad-4b0b-a05c-77661734461b" containerName="main" Jul 07 02:59:32.887187 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.887111 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="30bf0677-e2ad-4b0b-a05c-77661734461b" containerName="main" Jul 07 02:59:32.890304 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.890280 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:32.893154 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.893127 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtppw\"/\"kube-root-ca.crt\"" Jul 07 02:59:32.893154 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.893140 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtppw\"/\"openshift-service-ca.crt\"" Jul 07 02:59:32.893579 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.893564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wtppw\"/\"default-dockercfg-npm2w\"" Jul 07 02:59:32.902830 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.902793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:32.903699 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:32.903680 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/must-gather-rqvbw"] Jul 07 02:59:33.004312 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.004271 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" limit=1024 Jul 07 02:59:33.030248 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.030220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cqgl\" (UniqueName: \"kubernetes.io/projected/b4f05812-0f1b-4a55-a11d-5a349affc126-kube-api-access-2cqgl\") pod \"must-gather-rqvbw\" (UID: \"b4f05812-0f1b-4a55-a11d-5a349affc126\") " pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.030414 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.030262 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f05812-0f1b-4a55-a11d-5a349affc126-must-gather-output\") pod \"must-gather-rqvbw\" (UID: \"b4f05812-0f1b-4a55-a11d-5a349affc126\") " pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.131434 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.131392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cqgl\" (UniqueName: \"kubernetes.io/projected/b4f05812-0f1b-4a55-a11d-5a349affc126-kube-api-access-2cqgl\") pod \"must-gather-rqvbw\" (UID: \"b4f05812-0f1b-4a55-a11d-5a349affc126\") " pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.131434 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.131440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f05812-0f1b-4a55-a11d-5a349affc126-must-gather-output\") pod \"must-gather-rqvbw\" (UID: \"b4f05812-0f1b-4a55-a11d-5a349affc126\") " pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.131777 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.131758 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4f05812-0f1b-4a55-a11d-5a349affc126-must-gather-output\") pod \"must-gather-rqvbw\" (UID: \"b4f05812-0f1b-4a55-a11d-5a349affc126\") " pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.142130 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.142066 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cqgl\" (UniqueName: \"kubernetes.io/projected/b4f05812-0f1b-4a55-a11d-5a349affc126-kube-api-access-2cqgl\") pod \"must-gather-rqvbw\" (UID: \"b4f05812-0f1b-4a55-a11d-5a349affc126\") " pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.199629 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.199588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/must-gather-rqvbw" Jul 07 02:59:33.341702 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.341679 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/must-gather-rqvbw"] Jul 07 02:59:33.343391 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:59:33.343356 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4f05812_0f1b_4a55_a11d_5a349affc126.slice/crio-d4e5518c08c0fc5d0a0475cffb4f82d70afd3356038ff4847a0bcea685b388f6 WatchSource:0}: Error finding container d4e5518c08c0fc5d0a0475cffb4f82d70afd3356038ff4847a0bcea685b388f6: Status 404 returned error can't find the container with id d4e5518c08c0fc5d0a0475cffb4f82d70afd3356038ff4847a0bcea685b388f6 Jul 07 02:59:33.345112 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.345094 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:59:33.564296 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:33.564262 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/must-gather-rqvbw" event={"ID":"b4f05812-0f1b-4a55-a11d-5a349affc126","Type":"ContainerStarted","Data":"d4e5518c08c0fc5d0a0475cffb4f82d70afd3356038ff4847a0bcea685b388f6"} Jul 07 02:59:34.571360 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:34.571313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/must-gather-rqvbw" event={"ID":"b4f05812-0f1b-4a55-a11d-5a349affc126","Type":"ContainerStarted","Data":"2dcbb5d63590182d83a274c969f9eb1be7cf4f9037be9fa1c958ceb93559e41a"} Jul 07 02:59:34.571360 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:34.571366 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/must-gather-rqvbw" event={"ID":"b4f05812-0f1b-4a55-a11d-5a349affc126","Type":"ContainerStarted","Data":"bee2989e94fe66ad541435197261c77705a55f9a56ff5f4053378a74f10a619b"} Jul 07 02:59:34.586520 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:34.586458 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtppw/must-gather-rqvbw" podStartSLOduration=1.835973732 podStartE2EDuration="2.586434866s" totalImagesPullingTime="750.461134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:59:34.585818217 +0000 UTC m=+2676.080842751" watchObservedRunningTime="2026-07-07 02:59:34.586434866 +0000 UTC m=+2676.081459399" Jul 07 02:59:35.793241 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:35.793214 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qtjbj_bce55014-ddb8-4cd4-9652-b44f92053d6f/global-pull-secret-syncer/0.log" Jul 07 02:59:35.847175 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:35.847135 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9nxr8_674cda71-7265-4222-a544-462259875c68/konnectivity-agent/0.log" Jul 07 02:59:35.940748 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:35.940716 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-186.ec2.internal_2ce2cf4076b6f479baf250b405f7ccd8/haproxy/0.log" Jul 07 02:59:40.251012 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.250978 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b_31ab40ac-9c2a-4d9b-ae31-3b2403a7db66/extract/0.log" Jul 07 02:59:40.273173 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.273144 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b_31ab40ac-9c2a-4d9b-ae31-3b2403a7db66/util/0.log" Jul 07 02:59:40.295521 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.295490 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hf28b_31ab40ac-9c2a-4d9b-ae31-3b2403a7db66/pull/0.log" Jul 07 02:59:40.324679 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.324622 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2_21a883a1-9981-4989-b191-75860e37a02a/extract/0.log" Jul 07 02:59:40.347666 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.347620 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2_21a883a1-9981-4989-b191-75860e37a02a/util/0.log" Jul 07 02:59:40.373889 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.373850 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e065df2_21a883a1-9981-4989-b191-75860e37a02a/pull/0.log" Jul 07 02:59:40.413654 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.413603 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp_eab19e08-aa68-487f-89ca-829b668c1967/extract/0.log" Jul 07 02:59:40.435559 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.435528 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp_eab19e08-aa68-487f-89ca-829b668c1967/util/0.log" Jul 07 02:59:40.463290 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.463264 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zvgxp_eab19e08-aa68-487f-89ca-829b668c1967/pull/0.log" Jul 07 02:59:40.496561 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.496535 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v_b79ee471-c4fb-48ad-a09b-91760a1f51b8/extract/0.log" Jul 07 02:59:40.529887 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.529787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v_b79ee471-c4fb-48ad-a09b-91760a1f51b8/util/0.log" Jul 07 02:59:40.550600 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.550567 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j4g6v_b79ee471-c4fb-48ad-a09b-91760a1f51b8/pull/0.log" Jul 07 02:59:40.885368 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:40.884118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55c57b679f-gqtrf_8a7acb9e-26a6-48a4-9d19-ff7860578dc7/authorino/0.log" Jul 07 02:59:41.003558 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:41.003531 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w7fzq_b3c677e5-b562-40bc-a7b5-b15faa693e1d/kuadrant-console-plugin/0.log" Jul 07 02:59:41.206482 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:41.206395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rpptr_9e272336-2774-40a3-8124-359e17815c26/limitador/0.log" Jul 07 02:59:43.034287 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.034212 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-xdvtx_d684618c-cf96-46c2-a898-e3f4fc8edd6a/cluster-monitoring-operator/0.log" Jul 07 02:59:43.186440 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.186377 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b8cdf547f-pcsx6_15d79030-8e33-4466-bfe6-5eb7d028b54b/metrics-server/0.log" Jul 07 02:59:43.239020 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.238996 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-djqj4_a72686f3-b327-4e21-9180-8e431803d6e4/monitoring-plugin/0.log" Jul 07 02:59:43.485919 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.485884 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnbdf_1210f72a-313a-44d1-ba20-f75fe65c14cd/node-exporter/0.log" Jul 07 02:59:43.509501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.509475 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnbdf_1210f72a-313a-44d1-ba20-f75fe65c14cd/kube-rbac-proxy/0.log" Jul 07 02:59:43.534095 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.534065 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnbdf_1210f72a-313a-44d1-ba20-f75fe65c14cd/init-textfile/0.log" Jul 07 02:59:43.853105 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.852992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-cl45t_388a21ba-3221-444a-a99e-57f9e6231ef6/prometheus-operator/0.log" Jul 07 02:59:43.874630 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.874591 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-cl45t_388a21ba-3221-444a-a99e-57f9e6231ef6/kube-rbac-proxy/0.log" Jul 07 02:59:43.940662 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.940605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f8d549d8b-dtblb_35e75c1c-4b21-4193-b258-fd352f065e3a/telemeter-client/0.log" Jul 07 02:59:43.964101 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.964069 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f8d549d8b-dtblb_35e75c1c-4b21-4193-b258-fd352f065e3a/reload/0.log" Jul 07 02:59:43.989460 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:43.989440 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f8d549d8b-dtblb_35e75c1c-4b21-4193-b258-fd352f065e3a/kube-rbac-proxy/0.log" Jul 07 02:59:46.061275 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.061241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 02:59:46.066426 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.066399 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/2.log" Jul 07 02:59:46.163794 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.163750 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w"] Jul 07 02:59:46.169000 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.168971 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.177071 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.177040 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w"] Jul 07 02:59:46.272031 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.271989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-proc\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.272254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.272061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-sys\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.272254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.272097 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk46k\" (UniqueName: \"kubernetes.io/projected/a14bc25c-cf63-4a07-9f35-04676229d90b-kube-api-access-bk46k\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.272254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.272145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-lib-modules\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.272254 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.272177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-podres\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373537 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-proc\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373537 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-sys\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373537 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk46k\" (UniqueName: \"kubernetes.io/projected/a14bc25c-cf63-4a07-9f35-04676229d90b-kube-api-access-bk46k\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-proc\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-lib-modules\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373690 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-sys\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373717 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-lib-modules\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373746 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-podres\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.373861 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.373862 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a14bc25c-cf63-4a07-9f35-04676229d90b-podres\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.382518 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.382488 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk46k\" (UniqueName: \"kubernetes.io/projected/a14bc25c-cf63-4a07-9f35-04676229d90b-kube-api-access-bk46k\") pod \"perf-node-gather-daemonset-68w7w\" (UID: \"a14bc25c-cf63-4a07-9f35-04676229d90b\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.486650 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.486585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:46.684766 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.682376 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w"] Jul 07 02:59:46.685017 ip-10-0-133-186 kubenswrapper[2556]: W0707 02:59:46.684972 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda14bc25c_cf63_4a07_9f35_04676229d90b.slice/crio-dba9d240877c5770ce3f5da9a8726a623a54c6bf5636a0882541a3d3672eff65 WatchSource:0}: Error finding container dba9d240877c5770ce3f5da9a8726a623a54c6bf5636a0882541a3d3672eff65: Status 404 returned error can't find the container with id dba9d240877c5770ce3f5da9a8726a623a54c6bf5636a0882541a3d3672eff65 Jul 07 02:59:46.694750 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.694728 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fbc565f57-q8sdw_077a7af1-7582-48ff-a0d0-2ba6b8aae2df/console/0.log" Jul 07 02:59:46.731845 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:46.731811 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-wzggb_3debe371-0ff2-432e-8813-8bf61cadd474/download-server/0.log" Jul 07 02:59:47.367461 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:47.367413 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fgmt6_c1a6d08f-ecfe-4438-8e13-4a95cd9109df/volume-data-source-validator/0.log" Jul 07 02:59:47.682317 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:47.682197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" event={"ID":"a14bc25c-cf63-4a07-9f35-04676229d90b","Type":"ContainerStarted","Data":"2a6a8a0281e06af83b794feb88ad90908b1ce23ab61ea0d7ab4b00b2c8b0a951"} Jul 07 02:59:47.682503 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:47.682317 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" event={"ID":"a14bc25c-cf63-4a07-9f35-04676229d90b","Type":"ContainerStarted","Data":"dba9d240877c5770ce3f5da9a8726a623a54c6bf5636a0882541a3d3672eff65"} Jul 07 02:59:47.682573 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:47.682520 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:47.701598 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:47.701526 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" podStartSLOduration=1.701508493 podStartE2EDuration="1.701508493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:59:47.699749155 +0000 UTC m=+2689.194773686" watchObservedRunningTime="2026-07-07 02:59:47.701508493 +0000 UTC m=+2689.196533023" Jul 07 02:59:48.509495 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:48.509463 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mlkk2_f70d3d34-c676-42d0-973a-b6e0194e4536/dns/0.log" Jul 07 02:59:48.532573 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:48.532547 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mlkk2_f70d3d34-c676-42d0-973a-b6e0194e4536/kube-rbac-proxy/0.log" Jul 07 02:59:48.609501 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:48.609471 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cdthv_63a30a0d-2d40-4d25-9446-8396ef1c1a36/dns-node-resolver/0.log" Jul 07 02:59:49.228863 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:49.228822 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c946f6d5c-x9wpr_4b70dad6-4b57-4e74-a3ad-7da8de00fa0c/registry/0.log" Jul 07 02:59:49.311135 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:49.311099 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hk8cw_f3b765d1-889d-4154-9f56-408bd962bbd4/node-ca/0.log" Jul 07 02:59:50.455944 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:50.455898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-8kvmk_d0284b30-881e-45e1-82ba-6425509ab352/kube-auth-proxy/0.log" Jul 07 02:59:51.484816 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:51.484787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnzc2_70b356e7-a809-4a2a-90b2-abf3a67dabed/serve-healthcheck-canary/0.log" Jul 07 02:59:52.002562 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:52.002530 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bzph6_e9a5a71c-a1e8-4c59-b3a6-1186d4202d93/kube-rbac-proxy/0.log" Jul 07 02:59:52.025807 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:52.025776 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bzph6_e9a5a71c-a1e8-4c59-b3a6-1186d4202d93/exporter/0.log" Jul 07 02:59:52.052529 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:52.052498 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bzph6_e9a5a71c-a1e8-4c59-b3a6-1186d4202d93/extractor/0.log" Jul 07 02:59:53.701161 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:53.701133 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-68w7w" Jul 07 02:59:54.923479 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:54.923450 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvgjj_c36ac8b2-b206-4be3-b8af-09e1017b7e25/server/0.log" Jul 07 02:59:55.010994 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:55.010960 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fmfm6_fe03661b-9f5f-4b82-ae91-f91895259b43/manager/0.log" Jul 07 02:59:55.219969 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:55.219891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r47kn_115e3778-6036-4ae1-b670-fcc9bc195805/manager/0.log" Jul 07 02:59:55.238572 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:55.238544 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r47kn_115e3778-6036-4ae1-b670-fcc9bc195805/copy-manifests/0.log" Jul 07 02:59:56.822961 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:56.822932 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb48ccbfc-j52m7_a544554a-6329-4264-9afd-7f44250c4bf1/manager/0.log" Jul 07 02:59:57.288461 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:57.288404 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-8kvmk_d0284b30-881e-45e1-82ba-6425509ab352/kube-auth-proxy/0.log" Jul 07 02:59:58.842388 ip-10-0-133-186 kubenswrapper[2556]: I0707 02:59:58.842296 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654bb68cf4-8kvmk_d0284b30-881e-45e1-82ba-6425509ab352/kube-auth-proxy/0.log" Jul 07 03:00:02.055558 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:02.055417 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 03:00:02.079036 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:02.060134 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 03:00:02.079036 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:02.063608 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jds8q_920959fb-119c-48b0-a66b-6ccc6077c13b/console-operator/1.log" Jul 07 03:00:02.079036 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:02.067241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cvqzg_82fde3a3-524c-46f5-9057-526594cff32b/ovn-acl-logging/0.log" Jul 07 03:00:02.129294 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:02.129264 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fn8j6_5315cbdc-c4f7-4d88-a973-2be17545c0de/migrator/0.log" Jul 07 03:00:02.151110 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:02.151084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fn8j6_5315cbdc-c4f7-4d88-a973-2be17545c0de/graceful-termination/0.log" Jul 07 03:00:03.558892 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.558864 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/kube-multus-additional-cni-plugins/0.log" Jul 07 03:00:03.582472 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.582436 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/egress-router-binary-copy/0.log" Jul 07 03:00:03.606056 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.606013 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/cni-plugins/0.log" Jul 07 03:00:03.629377 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.629291 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/bond-cni-plugin/0.log" Jul 07 03:00:03.656914 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.656879 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/routeoverride-cni/0.log" Jul 07 03:00:03.679832 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.679800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/whereabouts-cni-bincopy/0.log" Jul 07 03:00:03.705073 ip-10-0-133-186 kubenswrapper[2556]: I0707 03:00:03.705044 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-848sh_9536b688-9423-45be-994c-38aa1697af9c/whereabouts-cni/0.log"